Nov 18 15:27:27 user nova-compute[74839]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74839) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 15:27:27 user nova-compute[74839]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74839) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 15:27:27 user nova-compute[74839]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74839) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 18 15:27:27 user nova-compute[74839]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 18 15:27:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:27:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:27:28 user nova-compute[74839]: INFO nova.virt.driver [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 18 15:27:28 user nova-compute[74839]: INFO nova.compute.provider_config [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Acquiring lock "singleton_lock" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Acquired lock "singleton_lock" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Releasing lock "singleton_lock" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Full set of CONF: {{(pid=74839) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ******************************************************************************** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Configuration options gathered from: {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ================================================================================ {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] allow_resize_to_same_host      = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] arq_binding_timeout            = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] backdoor_port                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] backdoor_socket                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] block_device_allocate_retries  = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] block_device_allocate_retries_interval = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cert                           = self.pem {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute_monitors               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] config_dir                     = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] config_drive_format            = iso9660 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] config_source                  = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] console_host                   = user {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] control_exchange               = nova {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cpu_allocation_ratio           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] daemon                         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] debug                          = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_access_ip_network_name = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_availability_zone      = nova {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_ephemeral_format       = ext4 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_green_pool_size        = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] default_schedule_zone          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] disk_allocation_ratio          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] enable_new_services            = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] enabled_ssl_apis               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] flat_injected                  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] force_config_drive             = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] force_raw_images               = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] graceful_shutdown_timeout      = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] heal_instance_info_cache_interval = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] host                           = user {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_build_timeout         = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_delete_interval       = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_name_template         = instance-%08x {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_usage_audit           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_usage_audit_period    = month {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] internal_service_availability_zone = internal {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] key                            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] live_migration_retry_count     = 30 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_config_append              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_dir                        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_file                       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_options                    = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_rotate_interval            = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_rotate_interval_type       = days {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] log_rotation_type              = none {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] long_rpc_timeout               = 1800 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_concurrent_builds          = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_concurrent_live_migrations = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_concurrent_snapshots       = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_local_block_devices        = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_logfile_count              = 30 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] max_logfile_size_mb            = 200 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] maximum_instance_delete_attempts = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metadata_listen                = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metadata_listen_port           = 8775 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metadata_workers               = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] migrate_max_retries            = -1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] mkisofs_cmd                    = genisoimage {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] my_ip                          = 10.0.0.210 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] network_allocate_retries       = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] osapi_compute_listen_port      = 8774 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] osapi_compute_unique_server_name_scope =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] osapi_compute_workers          = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] password_length                = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] periodic_enable                = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] periodic_fuzzy_delay           = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] pointer_model                  = ps2mouse {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] preallocate_images             = none {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] publish_errors                 = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] pybasedir                      = /opt/stack/nova {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ram_allocation_ratio           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rate_limit_burst               = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rate_limit_except_level        = CRITICAL {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rate_limit_interval            = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reboot_timeout                 = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reclaim_instance_interval      = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] record                         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reimage_timeout_per_gb         = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] report_interval                = 120 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rescue_timeout                 = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reserved_host_cpus             = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reserved_host_disk_mb          = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reserved_host_memory_mb        = 512 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] reserved_huge_pages            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] resize_confirm_window          = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] resize_fs_using_block_device   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] resume_guests_state_on_host_boot = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rpc_response_timeout           = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] run_external_periodic_tasks    = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] running_deleted_instance_action = reap {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] running_deleted_instance_timeout = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler_instance_sync_interval = 120 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_down_time              = 720 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] servicegroup_driver            = db {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] shelved_offload_time           = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] shelved_poll_interval          = 3600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] shutdown_timeout               = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] source_is_ipv6                 = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ssl_only                       = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] state_path                     = /opt/stack/data/nova {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] sync_power_state_interval      = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] sync_power_state_pool_size     = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] syslog_log_facility            = LOG_USER {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] tempdir                        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] timeout_nbd                    = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] transport_url                  = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] update_resources_interval      = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_cow_images                 = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_eventlog                   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_journal                    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_json                       = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_rootwrap_daemon            = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_stderr                     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] use_syslog                     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vcpu_pin_set                   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plugging_is_fatal          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plugging_timeout           = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] virt_mkfs                      = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] volume_usage_poll_interval     = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] watch_log_file                 = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] web                            = /usr/share/spice-html5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.auth_strategy              = keystone {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.compute_link_prefix        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.dhcp_domain                = novalocal {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.enable_instance_password   = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.glance_link_prefix         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.instance_list_per_project_cells = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.list_records_by_skipping_down_cells = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.local_metadata_per_cell    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.max_limit                  = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.metadata_cache_expiration  = 15 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.neutron_default_tenant_id  = default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.use_forwarded_for          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.use_neutron_default_nets   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_dynamic_targets = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_jsonfile_path   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.backend_argument         = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.config_prefix            = cache.oslo {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.dead_timeout             = 60.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.debug_cache_backend      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.enable_retry_client      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.enable_socket_keepalive  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.enabled                  = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.expiration_time          = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_dead_retry      = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_password        =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_sasl_enabled    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.memcache_username        =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.proxies                  = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.retry_attempts           = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.retry_delay              = 0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.socket_keepalive_count   = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.socket_keepalive_interval = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.tls_allowed_ciphers      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.tls_cafile               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.tls_certfile             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.tls_enabled              = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cache.tls_keyfile              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.auth_section            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.auth_type               = password {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.cafile                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.certfile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.collect_timing          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.cross_az_attach         = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.debug                   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.endpoint_template       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.http_retries            = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.insecure                = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.keyfile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.os_region_name          = RegionOne {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.split_loggers           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cinder.timeout                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.cpu_dedicated_set      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.cpu_shared_set         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.image_type_exclude_list = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.resource_provider_association_refresh = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.shutdown_retry_interval = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] conductor.workers              = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] console.allowed_origins        = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] console.ssl_ciphers            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] console.ssl_minimum_version    = default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] consoleauth.token_ttl          = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.cafile                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.certfile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.collect_timing          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.connect_retries         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.connect_retry_delay     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.endpoint_override       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.insecure                = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.keyfile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.max_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.min_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.region_name             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.service_name            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.service_type            = accelerator {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.split_loggers           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.status_code_retries     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.timeout                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] cyborg.version                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.backend               = sqlalchemy {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.connection            = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.connection_debug      = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.connection_parameters =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.connection_recycle_time = 3600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.connection_trace      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.db_inc_retry_interval = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.db_max_retries        = 20 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.db_max_retry_interval = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.db_retry_interval     = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.max_overflow          = 50 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.max_pool_size         = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.max_retries           = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.pool_timeout          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.retry_interval        = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.slave_connection      = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] database.sqlite_synchronous    = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.backend           = sqlalchemy {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.connection        = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.connection_debug  = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.connection_parameters =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.connection_recycle_time = 3600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.connection_trace  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.db_inc_retry_interval = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.db_max_retries    = 20 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.db_max_retry_interval = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.db_retry_interval = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.max_overflow      = 50 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.max_pool_size     = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.max_retries       = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.pool_timeout      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.retry_interval    = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.slave_connection  = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] api_database.sqlite_synchronous = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] devices.enabled_mdev_types     = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ephemeral_storage_encryption.enabled = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.api_servers             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.cafile                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.certfile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.collect_timing          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.connect_retries         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.connect_retry_delay     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.debug                   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.default_trusted_certificate_ids = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.enable_certificate_validation = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.enable_rbd_download     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.endpoint_override       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.insecure                = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.keyfile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.max_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.min_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.num_retries             = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.rbd_ceph_conf           =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.rbd_connect_timeout     = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.rbd_pool                =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.rbd_user                =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.region_name             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.service_name            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.service_type            = image {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.split_loggers           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.status_code_retries     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.timeout                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.verify_glance_signatures = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] glance.version                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] guestfs.debug                  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.config_drive_cdrom      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.config_drive_inject_password = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.enable_remotefx         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.instances_path_share    =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.limit_cpu_features      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.use_multipath_io        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.vswitch_name            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] mks.enabled                    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.manager_interval   = 2400 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.precache_concurrency = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.remove_unused_base_images = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] image_cache.subdirectory_name  = _base {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.api_max_retries         = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.api_retry_interval      = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.auth_section            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.auth_type               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.cafile                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.certfile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.collect_timing          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.conductor_group         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.connect_retries         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.connect_retry_delay     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.endpoint_override       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.insecure                = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.keyfile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.max_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.min_version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.peer_list               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.region_name             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.serial_console_state_timeout = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.service_name            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.service_type            = baremetal {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.split_loggers           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.status_code_retries     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.timeout                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ironic.version                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] key_manager.fixed_key          = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.barbican_api_version  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.barbican_endpoint     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.barbican_endpoint_type = public {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.barbican_region_name  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.cafile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.certfile              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.collect_timing        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.insecure              = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.keyfile               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.number_of_retries     = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.retry_delay           = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.send_service_user_token = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.split_loggers         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.timeout               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.verify_ssl            = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican.verify_ssl_path       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.auth_section = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.auth_type = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.cafile   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.certfile = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.collect_timing = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.insecure = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.keyfile  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.split_loggers = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] barbican_service_user.timeout  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.approle_role_id          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.approle_secret_id        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.cafile                   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.certfile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.collect_timing           = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.insecure                 = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.keyfile                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.kv_mountpoint            = secret {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.kv_path                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.kv_version               = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.namespace                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.root_token_id            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.split_loggers            = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.ssl_ca_crt_file          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.timeout                  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.use_ssl                  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.auth_section          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.auth_type             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.cafile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.certfile              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.collect_timing        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.connect_retries       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.connect_retry_delay   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.endpoint_override     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.insecure              = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.keyfile               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.max_version           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.min_version           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.region_name           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.service_name          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.service_type          = identity {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.split_loggers         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.status_code_retries   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.timeout               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] keystone.version               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.connection_uri         =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_mode               = custom {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: WARNING oslo_config.cfg [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_power_governor_high = performance {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_power_management   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.device_detach_attempts = 8 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.device_detach_timeout  = 20 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.disk_cachemodes        = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.disk_prefix            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.enabled_perf_events    = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.file_backed_memory     = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.gid_maps               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.hw_disk_discard        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.hw_machine_type        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_rbd_pool        = rbd {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_type            = default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.images_volume_group    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.inject_key             = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.inject_partition       = -2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.inject_password        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.iscsi_iface            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.iser_use_multipath     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_downtime = 500 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_inbound_addr = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_scheme  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_timeout_action = abort {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_tunnelled = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: WARNING oslo_config.cfg [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 18 15:27:28 user nova-compute[74839]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 18 15:27:28 user nova-compute[74839]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 18 15:27:28 user nova-compute[74839]: and ``live_migration_inbound_addr`` respectively.
Nov 18 15:27:28 user nova-compute[74839]: ).  Its value may be silently ignored in the future.
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.live_migration_with_native_tls = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.max_queues             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.nfs_mount_options      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_pcie_ports         = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.pmem_namespaces        = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.quobyte_client_cfg     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rbd_secret_uuid        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rbd_user               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rescue_image_id        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rescue_kernel_id       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.rx_queue_size          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.smbfs_mount_options    =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.snapshot_compression   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.snapshot_image_format  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.sparse_logical_volumes = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.swtpm_enabled          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.swtpm_group            = tss {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.swtpm_user             = tss {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.sysinfo_serial         = unique {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.tb_cache_size          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.tx_queue_size          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.uid_maps               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.use_virtio_for_bridges = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.virt_type              = kvm {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.volume_clear           = zero {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.volume_clear_size      = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.volume_use_multipath   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_cache_path   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.auth_section           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.auth_type              = password {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.cafile                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.certfile               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.collect_timing         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.connect_retries        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.connect_retry_delay    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.default_floating_pool  = public {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.endpoint_override      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.extension_sync_interval = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.http_retries           = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.insecure               = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.keyfile                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.max_version            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.min_version            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.ovs_bridge             = br-int {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.physnets               = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.region_name            = RegionOne {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.service_metadata_proxy = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.service_name           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.service_type           = network {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.split_loggers          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.status_code_retries    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.timeout                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] neutron.version                = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] notifications.bdms_in_notifications = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] notifications.default_level    = INFO {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] notifications.notification_format = unversioned {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] notifications.notify_on_state_change = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] pci.alias                      = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] pci.device_spec                = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] pci.report_in_placement        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.auth_section         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.auth_type            = password {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.cafile               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.certfile             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.collect_timing       = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.connect_retries      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.connect_retry_delay  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.default_domain_id    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.default_domain_name  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.domain_id            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.domain_name          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.endpoint_override    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.insecure             = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.keyfile              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.max_version          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.min_version          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.password             = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.project_domain_id    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.project_domain_name  = Default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.project_id           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.project_name         = service {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.region_name          = RegionOne {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.service_name         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.service_type         = placement {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.split_loggers        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.status_code_retries  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.system_scope         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.timeout              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.trust_id             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.user_domain_id       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.user_domain_name     = Default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.user_id              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.username             = placement {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] placement.version              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.cores                    = 20 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.count_usage_from_placement = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.injected_file_content_bytes = 10240 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.injected_file_path_length = 255 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.injected_files           = 5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.instances                = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.key_pairs                = 100 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.metadata_items           = 128 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.ram                      = 51200 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.recheck_quota            = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.server_group_members     = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] quota.server_groups            = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rdp.enabled                    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.image_metadata_prefilter = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.max_attempts         = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.max_placement_results = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] scheduler.workers              = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.host_subset_size = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.isolated_hosts = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.isolated_images = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.pci_in_placement = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.track_instance_changes = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metrics.required               = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metrics.weight_multiplier      = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] metrics.weight_setting         = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.enabled         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.port_range      = 10000:20000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] serial_console.serialproxy_port = 6083 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.auth_section      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.auth_type         = password {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.cafile            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.certfile          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.collect_timing    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.insecure          = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.keyfile           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.send_service_user_token = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.split_loggers     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] service_user.timeout           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.agent_enabled            = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.enabled                  = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.html5proxy_port          = 6082 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.image_compression        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.jpeg_compression         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.playback_compression     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.server_listen            = 127.0.0.1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.streaming_mode           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] spice.zlib_compression         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] upgrade_levels.baseapi         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] upgrade_levels.compute         = auto {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] upgrade_levels.conductor       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] upgrade_levels.scheduler       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.cafile = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.certfile = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.insecure = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vendordata_dynamic_auth.timeout = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.api_retry_count         = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.ca_file                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.cache_prefix            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.cluster_name            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.connection_pool_size    = 10 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.console_delay_seconds   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.datastore_regex         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.host_ip                 = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.host_password           = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.host_port               = 443 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.host_username           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.insecure                = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.integration_bridge      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.maximum_objects         = 100 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.pbm_default_policy      = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.pbm_enabled             = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.pbm_wsdl_location       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.serial_port_proxy_uri   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.serial_port_service_uri = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.task_poll_interval      = 0.5 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.use_linked_clone        = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.vnc_keymap              = en-us {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.vnc_port                = 5900 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vmware.vnc_port_total          = 10000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.auth_schemes               = ['none'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.enabled                    = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.novncproxy_port            = 6080 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.vencrypt_ca_certs          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.vencrypt_client_cert       = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vnc.vencrypt_client_key        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.disable_rootwrap   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.enable_numa_live_migration = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.libvirt_disable_apic = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.client_socket_timeout     = 900 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.default_pool_size         = 1000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.keep_alive                = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.max_header_line           = 16384 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.ssl_ca_file               = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.ssl_cert_file             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.ssl_key_file              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.tcp_keepidle              = 600 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] zvm.ca_file                    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] zvm.cloud_connector_url        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] zvm.reachable_timeout          = 300 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.enforce_scope      = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.policy_default_rule = default {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.connection_string     = messaging:// {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.enabled               = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.es_doc_type           = notification {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.es_scroll_size        = 10000 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.es_scroll_time        = 2m {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.filter_error_trace    = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.hmac_keys             = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.sentinel_service_name = mymaster {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.socket_timeout        = 0.1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.trace_requests        = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler.trace_sqlalchemy      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler_jaeger.process_tags   = {} {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] profiler_otlp.service_name_prefix = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] remote_debug.host              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] remote_debug.port              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.auth_section        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.auth_type           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.cafile              = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.certfile            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.collect_timing      = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.connect_retries     = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.connect_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.endpoint_id         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.endpoint_override   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.insecure            = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.keyfile             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.max_version         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.min_version         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.region_name         = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.service_name        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.service_type        = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.split_loggers       = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.status_code_retries = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.status_code_retry_delay = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.timeout             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.valid_interfaces    = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_limit.version             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_reports.file_event_handler = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] oslo_reports.log_dir           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.group  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] vif_plug_ovs_privileged.user   = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.isolate_vif         = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] os_brick.lock_path             = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.capabilities   = [21] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.group          = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.helper_command = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] privsep_osbrick.user           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.group           = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.helper_command  = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] nova_sys_admin.user            = None {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG oslo_service.service [None req-c36e749a-4869-4c16-bcc9-f09d3d6716b0 None None] ******************************************************************************** {{(pid=74839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 18 15:27:28 user nova-compute[74839]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Connecting to libvirt: qemu:///system {{(pid=74839) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd4a1356410> {{(pid=74839) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 18 15:27:28 user nova-compute[74839]: libvirt:  error : internal error: could not initialize domain event timer
Nov 18 15:27:28 user nova-compute[74839]: WARNING nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd4a1356410> {{(pid=74839) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Starting native event thread {{(pid=74839) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Starting green dispatch thread {{(pid=74839) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Starting connection event dispatch thread {{(pid=74839) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 18 15:27:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Connection event '1' reason 'None'
Nov 18 15:27:28 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 15:27:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.mount [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Initialising _HostMountState generation 0 {{(pid=74839) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 18 15:27:36 user nova-compute[74839]: INFO nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host capabilities <capabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <host>
Nov 18 15:27:36 user nova-compute[74839]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 18 15:27:36 user nova-compute[74839]:     <cpu>
Nov 18 15:27:36 user nova-compute[74839]:       <arch>x86_64</arch>
Nov 18 15:27:36 user nova-compute[74839]:       <model>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <microcode version='1070'/>
Nov 18 15:27:36 user nova-compute[74839]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='osxsave'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='invtsc'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='rsba'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature name='skip-l1dfl-vmentry'/>
Nov 18 15:27:36 user nova-compute[74839]:       <pages unit='KiB' size='4'/>
Nov 18 15:27:36 user nova-compute[74839]:       <pages unit='KiB' size='2048'/>
Nov 18 15:27:36 user nova-compute[74839]:     </cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <power_management>
Nov 18 15:27:36 user nova-compute[74839]:       <suspend_mem/>
Nov 18 15:27:36 user nova-compute[74839]:       <suspend_disk/>
Nov 18 15:27:36 user nova-compute[74839]:       <suspend_hybrid/>
Nov 18 15:27:36 user nova-compute[74839]:     </power_management>
Nov 18 15:27:36 user nova-compute[74839]:     <iommu support='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <migration_features>
Nov 18 15:27:36 user nova-compute[74839]:       <live/>
Nov 18 15:27:36 user nova-compute[74839]:       <uri_transports>
Nov 18 15:27:36 user nova-compute[74839]:         <uri_transport>tcp</uri_transport>
Nov 18 15:27:36 user nova-compute[74839]:         <uri_transport>rdma</uri_transport>
Nov 18 15:27:36 user nova-compute[74839]:       </uri_transports>
Nov 18 15:27:36 user nova-compute[74839]:     </migration_features>
Nov 18 15:27:36 user nova-compute[74839]:     <topology>
Nov 18 15:27:36 user nova-compute[74839]:       <cells num='2'>
Nov 18 15:27:36 user nova-compute[74839]:         <cell id='0'>
Nov 18 15:27:36 user nova-compute[74839]:           <memory unit='KiB'>8140616</memory>
Nov 18 15:27:36 user nova-compute[74839]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 18 15:27:36 user nova-compute[74839]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 15:27:36 user nova-compute[74839]:           <distances>
Nov 18 15:27:36 user nova-compute[74839]:             <sibling id='0' value='10'/>
Nov 18 15:27:36 user nova-compute[74839]:             <sibling id='1' value='20'/>
Nov 18 15:27:36 user nova-compute[74839]:           </distances>
Nov 18 15:27:36 user nova-compute[74839]:           <cpus num='6'>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 18 15:27:36 user nova-compute[74839]:           </cpus>
Nov 18 15:27:36 user nova-compute[74839]:         </cell>
Nov 18 15:27:36 user nova-compute[74839]:         <cell id='1'>
Nov 18 15:27:36 user nova-compute[74839]:           <memory unit='KiB'>8255068</memory>
Nov 18 15:27:36 user nova-compute[74839]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 18 15:27:36 user nova-compute[74839]:           <pages unit='KiB' size='2048'>0</pages>
Nov 18 15:27:36 user nova-compute[74839]:           <distances>
Nov 18 15:27:36 user nova-compute[74839]:             <sibling id='0' value='20'/>
Nov 18 15:27:36 user nova-compute[74839]:             <sibling id='1' value='10'/>
Nov 18 15:27:36 user nova-compute[74839]:           </distances>
Nov 18 15:27:36 user nova-compute[74839]:           <cpus num='6'>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 18 15:27:36 user nova-compute[74839]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 18 15:27:36 user nova-compute[74839]:           </cpus>
Nov 18 15:27:36 user nova-compute[74839]:         </cell>
Nov 18 15:27:36 user nova-compute[74839]:       </cells>
Nov 18 15:27:36 user nova-compute[74839]:     </topology>
Nov 18 15:27:36 user nova-compute[74839]:     <cache>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 18 15:27:36 user nova-compute[74839]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 18 15:27:36 user nova-compute[74839]:     </cache>
Nov 18 15:27:36 user nova-compute[74839]:     <secmodel>
Nov 18 15:27:36 user nova-compute[74839]:       <model>apparmor</model>
Nov 18 15:27:36 user nova-compute[74839]:       <doi>0</doi>
Nov 18 15:27:36 user nova-compute[74839]:     </secmodel>
Nov 18 15:27:36 user nova-compute[74839]:     <secmodel>
Nov 18 15:27:36 user nova-compute[74839]:       <model>dac</model>
Nov 18 15:27:36 user nova-compute[74839]:       <doi>0</doi>
Nov 18 15:27:36 user nova-compute[74839]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 18 15:27:36 user nova-compute[74839]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 18 15:27:36 user nova-compute[74839]:     </secmodel>
Nov 18 15:27:36 user nova-compute[74839]:   </host>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='alpha'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>clipper</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='armv6l'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>spitz</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>nuri</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>kzm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>z2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>tosa</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n810</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>terrier</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>midway</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>microbit</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>verdex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>highbank</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>akita</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>connex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>collie</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='armv7l'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>spitz</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>nuri</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>kzm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>z2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>tosa</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n810</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>terrier</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>midway</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>microbit</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>verdex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>highbank</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>akita</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>connex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>collie</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='aarch64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>integratorcp</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>borzoi</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>spitz</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>nuri</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-b1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatileab</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>kzm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>musca-a</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>smdkc210</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>z2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>tosa</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>sabrelite</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-eb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n810</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>n800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>versatilepb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>terrier</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mainstone</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>midway</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>musicpal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>microbit</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cubieboard</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>verdex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduino2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>raspi3b</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>raspi2b</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>cheetah</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>highbank</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>akita</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>connex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>collie</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>raspi0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <acpi default='on' toggle='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='cris'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='i686'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>isapc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>microvm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='kvm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <pae/>
Nov 18 15:27:36 user nova-compute[74839]:       <nonpae/>
Nov 18 15:27:36 user nova-compute[74839]:       <acpi default='on' toggle='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:       <apic default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='m68k'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>an5206</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>q800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>next-cube</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='microblaze'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='microblazeel'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='mips'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>malta</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='mipsel'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>malta</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='mips64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>malta</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>pica61</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>magnum</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='mips64el'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>malta</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mipssim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>pica61</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>magnum</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='16'>boston</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='ppc'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mac99</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>40p</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>taihu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='ppc64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>taihu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>40p</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mac99</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='ppc64le'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>taihu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ppce500</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>40p</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>pegasos2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>bamboo</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>g3beige</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>mac99</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sam460ex</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>ref405ep</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2048'>powernv8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='riscv32'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='8'>spike</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>opentitan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='8'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='riscv64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='8'>spike</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='5'>sifive_u</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>shakti_c</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sifive_e</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='8'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='s390x'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='sh4'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>shix</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>r2d</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='sh4eb'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>shix</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>r2d</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='sparc'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>SS-5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>SS-20</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>LX</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>SS-4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>SS-10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>Voyager</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='sparc64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sun4u</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>niagara</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>sun4v</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='x86_64'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>64</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>x-remote</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='1'>isapc</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>microvm</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='kvm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <acpi default='on' toggle='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:       <apic default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='xtensa'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>sim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>kc705</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ml605</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx200</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx60</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]:   <guest>
Nov 18 15:27:36 user nova-compute[74839]:     <os_type>hvm</os_type>
Nov 18 15:27:36 user nova-compute[74839]:     <arch name='xtensaeb'>
Nov 18 15:27:36 user nova-compute[74839]:       <wordsize>32</wordsize>
Nov 18 15:27:36 user nova-compute[74839]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='4'>sim</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>kc705</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ml605</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>virt</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx200</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>lx60</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 18 15:27:36 user nova-compute[74839]:       <domain type='qemu'/>
Nov 18 15:27:36 user nova-compute[74839]:     </arch>
Nov 18 15:27:36 user nova-compute[74839]:     <features>
Nov 18 15:27:36 user nova-compute[74839]:       <cpuselection/>
Nov 18 15:27:36 user nova-compute[74839]:       <deviceboot/>
Nov 18 15:27:36 user nova-compute[74839]:       <disksnapshot default='on' toggle='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     </features>
Nov 18 15:27:36 user nova-compute[74839]:   </guest>
Nov 18 15:27:36 user nova-compute[74839]: </capabilities>
Nov 18 15:27:36 user nova-compute[74839]: 
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-i440fx-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>i686</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='255'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'/>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='lm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ide</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-q35-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>i686</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='288'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'/>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='lm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-q35-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>i686</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='288'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'/>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='lm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-i386</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-i440fx-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>i686</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='255'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'/>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='lm'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ide</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-i440fx-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>x86_64</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='255'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>efi</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='invtsc'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='rsba'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ide</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-q35-jammy</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>x86_64</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='288'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>efi</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='invtsc'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='rsba'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-q35-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>x86_64</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='288'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>efi</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='invtsc'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='rsba'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 18 15:27:36 user nova-compute[74839]: <domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 18 15:27:36 user nova-compute[74839]:   <domain>kvm</domain>
Nov 18 15:27:36 user nova-compute[74839]:   <machine>pc-i440fx-6.2</machine>
Nov 18 15:27:36 user nova-compute[74839]:   <arch>x86_64</arch>
Nov 18 15:27:36 user nova-compute[74839]:   <vcpu max='255'/>
Nov 18 15:27:36 user nova-compute[74839]:   <iothreads supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:   <os supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='firmware'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>efi</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:     <loader supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>rom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pflash</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='readonly'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>yes</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='secure'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>no</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </loader>
Nov 18 15:27:36 user nova-compute[74839]:   </os>
Nov 18 15:27:36 user nova-compute[74839]:   <cpu>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-passthrough' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='hostPassthroughMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='maximum' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='maximumMigratable'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>on</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>off</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='host-model' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <vendor>Intel</vendor>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ss'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='vmx'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pcid'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='hypervisor'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arat'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='tsc_adjust'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='umip'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='md-clear'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='arch-capabilities'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='invtsc'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibpb'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='ibrs'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-stibp'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='amd-ssbd'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='rsba'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='require' name='pschange-mc-no'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='erms'/>
Nov 18 15:27:36 user nova-compute[74839]:       <feature policy='disable' name='xsaveopt'/>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:     <mode name='custom' supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>qemu64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>qemu32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>phenom</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>pentium</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>n270</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm64</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>kvm32</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>coreduo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>core2duo</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>athlon</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Westmere</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Snowridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Skylake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>SandyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Penryn</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G5</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G4</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G3</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Opteron_G2</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Opteron_G1</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>IvyBridge</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Icelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Haswell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Rome</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-Milan</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC-IBPB</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>EPYC</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Dhyana</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cooperlake</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>Conroe</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Cascadelake-Server</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-noTSX</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell-IBRS</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='no'>Broadwell</model>
Nov 18 15:27:36 user nova-compute[74839]:       <model usable='yes'>486</model>
Nov 18 15:27:36 user nova-compute[74839]:     </mode>
Nov 18 15:27:36 user nova-compute[74839]:   </cpu>
Nov 18 15:27:36 user nova-compute[74839]:   <memoryBacking supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:     <enum name='sourceType'>
Nov 18 15:27:36 user nova-compute[74839]:       <value>file</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>anonymous</value>
Nov 18 15:27:36 user nova-compute[74839]:       <value>memfd</value>
Nov 18 15:27:36 user nova-compute[74839]:     </enum>
Nov 18 15:27:36 user nova-compute[74839]:   </memoryBacking>
Nov 18 15:27:36 user nova-compute[74839]:   <devices>
Nov 18 15:27:36 user nova-compute[74839]:     <disk supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='diskDevice'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>disk</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cdrom</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>floppy</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>lun</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='bus'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ide</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>fdc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sata</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </disk>
Nov 18 15:27:36 user nova-compute[74839]:     <graphics supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='type'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>sdl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vnc</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>spice</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egl-headless</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </graphics>
Nov 18 15:27:36 user nova-compute[74839]:     <video supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='modelType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>cirrus</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>vmvga</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>qxl</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>none</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>bochs</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>ramfb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </video>
Nov 18 15:27:36 user nova-compute[74839]:     <hostdev supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='mode'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>subsystem</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='startupPolicy'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>default</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>mandatory</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>requisite</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>optional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='subsysType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>usb</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>pci</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>scsi</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='capsType'/>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='pciBackend'/>
Nov 18 15:27:36 user nova-compute[74839]:     </hostdev>
Nov 18 15:27:36 user nova-compute[74839]:     <rng supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtio-non-transitional</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>random</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>egd</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>builtin</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </rng>
Nov 18 15:27:36 user nova-compute[74839]:     <filesystem supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='driverType'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>path</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>handle</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>virtiofs</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </filesystem>
Nov 18 15:27:36 user nova-compute[74839]:     <tpm supported='yes'>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='model'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-tis</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>tpm-crb</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:       <enum name='backendModel'>
Nov 18 15:27:36 user nova-compute[74839]:         <value>passthrough</value>
Nov 18 15:27:36 user nova-compute[74839]:         <value>emulator</value>
Nov 18 15:27:36 user nova-compute[74839]:       </enum>
Nov 18 15:27:36 user nova-compute[74839]:     </tpm>
Nov 18 15:27:36 user nova-compute[74839]:   </devices>
Nov 18 15:27:36 user nova-compute[74839]:   <features>
Nov 18 15:27:36 user nova-compute[74839]:     <gic supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:     <vmcoreinfo supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <genid supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backingStoreInput supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <backup supported='yes'/>
Nov 18 15:27:36 user nova-compute[74839]:     <sev supported='no'/>
Nov 18 15:27:36 user nova-compute[74839]:   </features>
Nov 18 15:27:36 user nova-compute[74839]: </domainCapabilities>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74839) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74839) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Checking secure boot support for host arch (x86_64) {{(pid=74839) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Checking secure boot support for host arch (x86_64) {{(pid=74839) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Checking secure boot support for host arch (x86_64) {{(pid=74839) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 18 15:27:36 user nova-compute[74839]: INFO nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Secure Boot support detected
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] cpu compare xml: <cpu match="exact">
Nov 18 15:27:36 user nova-compute[74839]:   <model>Nehalem</model>
Nov 18 15:27:36 user nova-compute[74839]: </cpu>
Nov 18 15:27:36 user nova-compute[74839]:  {{(pid=74839) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 18 15:27:36 user nova-compute[74839]: INFO nova.virt.node [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Generated node identity 1b2bc3b9-1976-45c0-acc1-6705a8c2df60
Nov 18 15:27:36 user nova-compute[74839]: INFO nova.virt.node [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Wrote node identity 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 to /opt/stack/data/nova/compute_id
Nov 18 15:27:36 user nova-compute[74839]: WARNING nova.compute.manager [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Compute nodes ['1b2bc3b9-1976-45c0-acc1-6705a8c2df60'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 18 15:27:36 user nova-compute[74839]: INFO nova.compute.manager [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 18 15:27:36 user nova-compute[74839]: WARNING nova.compute.manager [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 18 15:27:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:27:36 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:27:36 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:27:36 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Hypervisor/Node resource view: name=user free_ram=10925MB free_disk=26.277446746826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:27:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:27:37 user nova-compute[74839]: WARNING nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] No compute node record for user:1b2bc3b9-1976-45c0-acc1-6705a8c2df60: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 could not be found.
Nov 18 15:27:37 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Compute node record created for user:user with uuid: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:27:37 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] [req-16ae9eb3-ce86-4afc-8190-e462dda1c95a] Created resource provider record via placement API for resource provider with UUID 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 and name user.
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74839) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 18 15:27:37 user nova-compute[74839]: INFO nova.virt.libvirt.host [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] kernel doesn't support AMD SEV
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Libvirt baseline CPU <cpu>
Nov 18 15:27:37 user nova-compute[74839]:   <arch>x86_64</arch>
Nov 18 15:27:37 user nova-compute[74839]:   <model>Nehalem</model>
Nov 18 15:27:37 user nova-compute[74839]:   <vendor>Intel</vendor>
Nov 18 15:27:37 user nova-compute[74839]:   <topology sockets="6" cores="1" threads="1"/>
Nov 18 15:27:37 user nova-compute[74839]: </cpu>
Nov 18 15:27:37 user nova-compute[74839]:  {{(pid=74839) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Updated inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Updating resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 generation from 0 to 1 during operation: update_inventory {{(pid=74839) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Updating resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 generation from 1 to 2 during operation: update_traits {{(pid=74839) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.service [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Creating RPC server for service compute {{(pid=74839) start /opt/stack/nova/nova/service.py:182}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.service [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] Join ServiceGroup membership for this service compute {{(pid=74839) start /opt/stack/nova/nova/service.py:199}}
Nov 18 15:27:37 user nova-compute[74839]: DEBUG nova.servicegroup.drivers.db [None req-38fdb15f-f782-435c-b8be-8b65c2ed5377 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74839) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 18 15:27:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:27:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:28:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:28:28 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:28:28 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=10381MB free_disk=26.18117904663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:28:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:29:29 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:29:30 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:29:30 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=10312MB free_disk=26.24549102783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:29:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:30:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:30:31 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:30:32 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:30:32 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=10296MB free_disk=25.997859954833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:30:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:31:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:32 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:31:33 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:33 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9594MB free_disk=26.01752471923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:31:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:31:36 user nova-compute[74839]: INFO nova.compute.claims [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Claim successful on node user
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:31:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:31:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Creating image(s)
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "/opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG nova.policy [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b86e5899c041e88609206af0613940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0b5e1598374e26b3b0c081e6ca38d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.part --force-share --output=json" returned: 0 in 0.159s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG nova.virt.images [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] e059a7e6-6151-4faa-8cc1-55745cc1f78a was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.part /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.part /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.converted" returned: 0 in 0.124s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.274s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:38 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3raf1aes/privsep.sock']
Nov 18 15:31:38 user sudo[84083]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3raf1aes/privsep.sock
Nov 18 15:31:38 user sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 15:31:39 user sudo[84083]: pam_unix(sudo:session): session closed for user root
Nov 18 15:31:39 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Spawned new privsep daemon via rootwrap
Nov 18 15:31:39 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 15:31:39 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 15:31:39 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 18 15:31:39 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84087
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.161s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk 1073741824" returned: 0 in 0.043s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Successfully created port: 1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:31:40 user nova-compute[74839]: INFO nova.compute.claims [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Claim successful on node user
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Cannot resize image /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Ensure instance console log exists: /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:31:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:31:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:31:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:31:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Creating image(s)
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "/opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "/opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG nova.policy [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca99d385812433ab0d7b3fe70aa5695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbc177b26e8480ca247735651037f07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk 1073741824" returned: 0 in 0.065s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.305s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:31:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Cannot resize image /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Ensure instance console log exists: /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:31:42 user nova-compute[74839]: INFO nova.compute.claims [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Claim successful on node user
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:31:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:31:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:31:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Successfully created port: ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG nova.policy [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7acc8cec037e4e0081c72125cc4c6db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfa5a922984458fbccbdebc0a906763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:31:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Creating image(s)
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.216s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk 1073741824" returned: 0 in 0.054s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.211s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Cannot resize image /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Ensure instance console log exists: /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Successfully updated port: ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquired lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:31:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-changed-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Refreshing instance network info cache due to event network-changed-ba011248-dfed-44f3-b61d-19fa011e8bce. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] Acquiring lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updating instance_info_cache with network_info: [{"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Releasing lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Instance network_info: |[{"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] Acquired lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Refreshing network info cache for port ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Start _get_guest_xml network_info=[{"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:31:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1242488551',display_name='tempest-DeleteServersTestJSON-server-1242488551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1242488551',id=2,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbc177b26e8480ca247735651037f07',ramdisk_id='',reservation_id='r-2zudjsz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-945016737',owner_user_name='tempest-DeleteServersTestJSON-945016737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:41Z,user_data=None,user_id='8ca99d385812433ab0d7b3fe70aa5695',uuid=3e387d43-67cf-453c-bc42-b1b380d18dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converting VIF {"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e387d43-67cf-453c-bc42-b1b380d18dee {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:31:45 user nova-compute[74839]:   <uuid>3e387d43-67cf-453c-bc42-b1b380d18dee</uuid>
Nov 18 15:31:45 user nova-compute[74839]:   <name>instance-00000002</name>
Nov 18 15:31:45 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:31:45 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:31:45 user nova-compute[74839]:   <metadata>
Nov 18 15:31:45 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:31:45 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:name>tempest-DeleteServersTestJSON-server-1242488551</nova:name>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:31:45</nova:creationTime>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:31:45 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:31:45 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:owner>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:user uuid="8ca99d385812433ab0d7b3fe70aa5695">tempest-DeleteServersTestJSON-945016737-project-member</nova:user>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:project uuid="cfbc177b26e8480ca247735651037f07">tempest-DeleteServersTestJSON-945016737</nova:project>
Nov 18 15:31:45 user nova-compute[74839]:       </nova:owner>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:31:45 user nova-compute[74839]:       <nova:ports>
Nov 18 15:31:45 user nova-compute[74839]:         <nova:port uuid="ba011248-dfed-44f3-b61d-19fa011e8bce">
Nov 18 15:31:45 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:31:45 user nova-compute[74839]:         </nova:port>
Nov 18 15:31:45 user nova-compute[74839]:       </nova:ports>
Nov 18 15:31:45 user nova-compute[74839]:     </nova:instance>
Nov 18 15:31:45 user nova-compute[74839]:   </metadata>
Nov 18 15:31:45 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:31:45 user nova-compute[74839]:     <system>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="serial">3e387d43-67cf-453c-bc42-b1b380d18dee</entry>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="uuid">3e387d43-67cf-453c-bc42-b1b380d18dee</entry>
Nov 18 15:31:45 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:31:45 user nova-compute[74839]:     </system>
Nov 18 15:31:45 user nova-compute[74839]:   </sysinfo>
Nov 18 15:31:45 user nova-compute[74839]:   <os>
Nov 18 15:31:45 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:31:45 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:31:45 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:31:45 user nova-compute[74839]:   </os>
Nov 18 15:31:45 user nova-compute[74839]:   <features>
Nov 18 15:31:45 user nova-compute[74839]:     <acpi/>
Nov 18 15:31:45 user nova-compute[74839]:     <apic/>
Nov 18 15:31:45 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:31:45 user nova-compute[74839]:   </features>
Nov 18 15:31:45 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:31:45 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:31:45 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:31:45 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:31:45 user nova-compute[74839]:   </clock>
Nov 18 15:31:45 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:31:45 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:31:45 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:31:45 user nova-compute[74839]:   </cpu>
Nov 18 15:31:45 user nova-compute[74839]:   <devices>
Nov 18 15:31:45 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:31:45 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:31:45 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk"/>
Nov 18 15:31:45 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:31:45 user nova-compute[74839]:     </disk>
Nov 18 15:31:45 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:31:45 user nova-compute[74839]:       <mac address="fa:16:3e:aa:4f:93"/>
Nov 18 15:31:45 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:45 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:31:45 user nova-compute[74839]:       <target dev="tapba011248-df"/>
Nov 18 15:31:45 user nova-compute[74839]:     </interface>
Nov 18 15:31:45 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:31:45 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/console.log" append="off"/>
Nov 18 15:31:45 user nova-compute[74839]:     </serial>
Nov 18 15:31:45 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:31:45 user nova-compute[74839]:     <video>
Nov 18 15:31:45 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:45 user nova-compute[74839]:     </video>
Nov 18 15:31:45 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:31:45 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:31:45 user nova-compute[74839]:     </rng>
Nov 18 15:31:45 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:31:45 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:31:45 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:31:45 user nova-compute[74839]:     </memballoon>
Nov 18 15:31:45 user nova-compute[74839]:   </devices>
Nov 18 15:31:45 user nova-compute[74839]: </domain>
Nov 18 15:31:45 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1242488551',display_name='tempest-DeleteServersTestJSON-server-1242488551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1242488551',id=2,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfbc177b26e8480ca247735651037f07',ramdisk_id='',reservation_id='r-2zudjsz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-945016737',owner_user_name='tempest-DeleteServersTestJSON-945016737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:41Z,user_data=None,user_id='8ca99d385812433ab0d7b3fe70aa5695',uuid=3e387d43-67cf-453c-bc42-b1b380d18dee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converting VIF {"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG os_vif [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Successfully updated port: 1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Created schema index Interface.name {{(pid=74839) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Created schema index Port.name {{(pid=74839) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Created schema index Bridge.name {{(pid=74839) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [POLLOUT] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00d0dcda-0150-5be5-adf0-e05c925972a4', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:45 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp1j_ru18e/privsep.sock']
Nov 18 15:31:45 user sudo[84152]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp1j_ru18e/privsep.sock
Nov 18 15:31:45 user sudo[84152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 15:31:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Successfully created port: 426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-changed-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Refreshing instance network info cache due to event network-changed-1d161523-2904-4c91-bce6-00b824139d03. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updated VIF entry in instance network info cache for port ba011248-dfed-44f3-b61d-19fa011e8bce. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updating instance_info_cache with network_info: [{"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b35f266-c702-44ab-b995-1c48549404f0 req-c692af41-96d2-49b0-9f76-cb3ab4c4bd9d service nova] Releasing lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user sudo[84152]: pam_unix(sudo:session): session closed for user root
Nov 18 15:31:47 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Spawned new privsep daemon via rootwrap
Nov 18 15:31:47 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 15:31:47 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 15:31:47 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 18 15:31:47 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84155
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Successfully updated port: 426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Instance network_info: |[{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Refreshing network info cache for port 1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Start _get_guest_xml network_info=[{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:31:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-257681794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-257681794',id=1,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-g1cf06ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:37Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:31:47 user nova-compute[74839]:   <uuid>7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5</uuid>
Nov 18 15:31:47 user nova-compute[74839]:   <name>instance-00000001</name>
Nov 18 15:31:47 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:31:47 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:31:47 user nova-compute[74839]:   <metadata>
Nov 18 15:31:47 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:31:47 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-257681794</nova:name>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:31:47</nova:creationTime>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:31:47 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:31:47 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:owner>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:31:47 user nova-compute[74839]:       </nova:owner>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:31:47 user nova-compute[74839]:       <nova:ports>
Nov 18 15:31:47 user nova-compute[74839]:         <nova:port uuid="1d161523-2904-4c91-bce6-00b824139d03">
Nov 18 15:31:47 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 15:31:47 user nova-compute[74839]:         </nova:port>
Nov 18 15:31:47 user nova-compute[74839]:       </nova:ports>
Nov 18 15:31:47 user nova-compute[74839]:     </nova:instance>
Nov 18 15:31:47 user nova-compute[74839]:   </metadata>
Nov 18 15:31:47 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:31:47 user nova-compute[74839]:     <system>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="serial">7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5</entry>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="uuid">7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5</entry>
Nov 18 15:31:47 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:31:47 user nova-compute[74839]:     </system>
Nov 18 15:31:47 user nova-compute[74839]:   </sysinfo>
Nov 18 15:31:47 user nova-compute[74839]:   <os>
Nov 18 15:31:47 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:31:47 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:31:47 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:31:47 user nova-compute[74839]:   </os>
Nov 18 15:31:47 user nova-compute[74839]:   <features>
Nov 18 15:31:47 user nova-compute[74839]:     <acpi/>
Nov 18 15:31:47 user nova-compute[74839]:     <apic/>
Nov 18 15:31:47 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:31:47 user nova-compute[74839]:   </features>
Nov 18 15:31:47 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:31:47 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:31:47 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:31:47 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:31:47 user nova-compute[74839]:   </clock>
Nov 18 15:31:47 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:31:47 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:31:47 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:31:47 user nova-compute[74839]:   </cpu>
Nov 18 15:31:47 user nova-compute[74839]:   <devices>
Nov 18 15:31:47 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:31:47 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:31:47 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk"/>
Nov 18 15:31:47 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:31:47 user nova-compute[74839]:     </disk>
Nov 18 15:31:47 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:31:47 user nova-compute[74839]:       <mac address="fa:16:3e:58:6c:11"/>
Nov 18 15:31:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:47 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:31:47 user nova-compute[74839]:       <target dev="tap1d161523-29"/>
Nov 18 15:31:47 user nova-compute[74839]:     </interface>
Nov 18 15:31:47 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:31:47 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/console.log" append="off"/>
Nov 18 15:31:47 user nova-compute[74839]:     </serial>
Nov 18 15:31:47 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:31:47 user nova-compute[74839]:     <video>
Nov 18 15:31:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:47 user nova-compute[74839]:     </video>
Nov 18 15:31:47 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:31:47 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:31:47 user nova-compute[74839]:     </rng>
Nov 18 15:31:47 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:31:47 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:31:47 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:31:47 user nova-compute[74839]:     </memballoon>
Nov 18 15:31:47 user nova-compute[74839]:   </devices>
Nov 18 15:31:47 user nova-compute[74839]: </domain>
Nov 18 15:31:47 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-257681794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-257681794',id=1,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-g1cf06ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:37Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG os_vif [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bffadf76-27df-5642-8546-2ec1620f8173', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba011248-df, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba011248-df, col_values=(('qos', UUID('7fa193c1-ed32-43ca-8674-9def659acbd0')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba011248-df, col_values=(('external_ids', {'iface-id': 'ba011248-dfed-44f3-b61d-19fa011e8bce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:4f:93', 'vm-uuid': '3e387d43-67cf-453c-bc42-b1b380d18dee'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: INFO os_vif [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df')
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d161523-29, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d161523-29, col_values=(('qos', UUID('eb3c61af-dd02-4f20-961a-149835c051ad')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d161523-29, col_values=(('external_ids', {'iface-id': '1d161523-2904-4c91-bce6-00b824139d03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:6c:11', 'vm-uuid': '7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:47 user nova-compute[74839]: INFO os_vif [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29')
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:58:6c:11, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] No VIF found with MAC fa:16:3e:aa:4f:93, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing instance network info cache due to event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:31:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updated VIF entry in instance network info cache for port 1d161523-2904-4c91-bce6-00b824139d03. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b19b5d4-a009-4c1b-a88f-9fc14aff1d21 req-96c9fff8-218e-4ad3-b8e3-0800ea814ec4 service nova] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance network_info: |[{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start _get_guest_xml network_info=[{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:31:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4yYZM8oolwsDs4eJztk8p2sQ0k4YOhUSFERwBo+fGrI5IIzDXx9u4GSboz1eZiv5F+oKNt5j4TNItG3hRprfPwCQd63vgOlTn69ZFk2uQpQp44zgZEeONz9kuC0ckSFw==',key_name='tempest-keypair-494084705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:31:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:31:48 user nova-compute[74839]:   <uuid>21d73872-2b83-48b1-b465-9309a293ad81</uuid>
Nov 18 15:31:48 user nova-compute[74839]:   <name>instance-00000003</name>
Nov 18 15:31:48 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:31:48 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:31:48 user nova-compute[74839]:   <metadata>
Nov 18 15:31:48 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:31:48 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-368053819</nova:name>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:31:48</nova:creationTime>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:31:48 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:31:48 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:owner>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:user uuid="7acc8cec037e4e0081c72125cc4c6db9">tempest-AttachVolumeShelveTestJSON-619260582-project-member</nova:user>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:project uuid="9bfa5a922984458fbccbdebc0a906763">tempest-AttachVolumeShelveTestJSON-619260582</nova:project>
Nov 18 15:31:48 user nova-compute[74839]:       </nova:owner>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:31:48 user nova-compute[74839]:       <nova:ports>
Nov 18 15:31:48 user nova-compute[74839]:         <nova:port uuid="426cda54-c5b6-404c-bba7-727c58ec4952">
Nov 18 15:31:48 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:31:48 user nova-compute[74839]:         </nova:port>
Nov 18 15:31:48 user nova-compute[74839]:       </nova:ports>
Nov 18 15:31:48 user nova-compute[74839]:     </nova:instance>
Nov 18 15:31:48 user nova-compute[74839]:   </metadata>
Nov 18 15:31:48 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:31:48 user nova-compute[74839]:     <system>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="serial">21d73872-2b83-48b1-b465-9309a293ad81</entry>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="uuid">21d73872-2b83-48b1-b465-9309a293ad81</entry>
Nov 18 15:31:48 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:31:48 user nova-compute[74839]:     </system>
Nov 18 15:31:48 user nova-compute[74839]:   </sysinfo>
Nov 18 15:31:48 user nova-compute[74839]:   <os>
Nov 18 15:31:48 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:31:48 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:31:48 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:31:48 user nova-compute[74839]:   </os>
Nov 18 15:31:48 user nova-compute[74839]:   <features>
Nov 18 15:31:48 user nova-compute[74839]:     <acpi/>
Nov 18 15:31:48 user nova-compute[74839]:     <apic/>
Nov 18 15:31:48 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:31:48 user nova-compute[74839]:   </features>
Nov 18 15:31:48 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:31:48 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:31:48 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:31:48 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:31:48 user nova-compute[74839]:   </clock>
Nov 18 15:31:48 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:31:48 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:31:48 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:31:48 user nova-compute[74839]:   </cpu>
Nov 18 15:31:48 user nova-compute[74839]:   <devices>
Nov 18 15:31:48 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:31:48 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:31:48 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk"/>
Nov 18 15:31:48 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:31:48 user nova-compute[74839]:     </disk>
Nov 18 15:31:48 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:31:48 user nova-compute[74839]:       <mac address="fa:16:3e:27:06:86"/>
Nov 18 15:31:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:48 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:31:48 user nova-compute[74839]:       <target dev="tap426cda54-c5"/>
Nov 18 15:31:48 user nova-compute[74839]:     </interface>
Nov 18 15:31:48 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:31:48 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/console.log" append="off"/>
Nov 18 15:31:48 user nova-compute[74839]:     </serial>
Nov 18 15:31:48 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:31:48 user nova-compute[74839]:     <video>
Nov 18 15:31:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:48 user nova-compute[74839]:     </video>
Nov 18 15:31:48 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:31:48 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:31:48 user nova-compute[74839]:     </rng>
Nov 18 15:31:48 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:31:48 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:31:48 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:31:48 user nova-compute[74839]:     </memballoon>
Nov 18 15:31:48 user nova-compute[74839]:   </devices>
Nov 18 15:31:48 user nova-compute[74839]: </domain>
Nov 18 15:31:48 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4yYZM8oolwsDs4eJztk8p2sQ0k4YOhUSFERwBo+fGrI5IIzDXx9u4GSboz1eZiv5F+oKNt5j4TNItG3hRprfPwCQd63vgOlTn69ZFk2uQpQp44zgZEeONz9kuC0ckSFw==',key_name='tempest-keypair-494084705',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG os_vif [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0aeb0a3f-525a-57e4-a27e-378853090d50', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap426cda54-c5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap426cda54-c5, col_values=(('qos', UUID('487b29f4-1892-4f8c-a426-fcfd8d979ad6')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap426cda54-c5, col_values=(('external_ids', {'iface-id': '426cda54-c5b6-404c-bba7-727c58ec4952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:06:86', 'vm-uuid': '21d73872-2b83-48b1-b465-9309a293ad81'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: INFO os_vif [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5')
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No VIF found with MAC fa:16:3e:27:06:86, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updated VIF entry in instance network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:31:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-96862fe8-8169-4b0a-bb7b-4e71b1decb06 req-f5e572db-ceca-4c17-8d41-87e685bd2b64 service nova] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:31:51 user nova-compute[74839]: INFO nova.compute.claims [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Claim successful on node user
Nov 18 15:31:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:31:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:31:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.policy [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '162cc08b925a423caa2f868e93dffdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e132ce68d4ff9bfd9e25e9e0dd141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:31:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Creating image(s)
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "/opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "/opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.233s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk 1073741824" returned: 0 in 0.062s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.216s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Cannot resize image /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Ensure instance console log exists: /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:31:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Instance spawned successfully.
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:31:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Instance spawned successfully.
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Took 17.29 seconds to spawn the instance on the hypervisor.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance spawned successfully.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Took 13.02 seconds to spawn the instance on the hypervisor.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Took 18.32 seconds to build instance.
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Took 10.87 seconds to spawn the instance on the hypervisor.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:31:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-808965ca-05f1-47a1-9cfa-fea8e0a0aece tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.653s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Took 14.06 seconds to build instance.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0feeb72d-2068-4af1-a90e-a06b43245ef7 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.196s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:54 user nova-compute[74839]: INFO nova.compute.manager [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Took 12.10 seconds to build instance.
Nov 18 15:31:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e3138fc-b388-4fcf-b940-6baf5e4cabbd tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.295s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:31:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Successfully created port: c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:31:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Successfully updated port: c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquired lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-changed-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Refreshing instance network info cache due to event network-changed-c306b011-a6ed-4eea-985f-1edac8cf46ee. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] Acquiring lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Releasing lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Instance network_info: |[{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] Acquired lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Refreshing network info cache for port c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Start _get_guest_xml network_info=[{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:31:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1706783870',display_name='tempest-VolumesAdminNegativeTest-server-1706783870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1706783870',id=4,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAdzlquspOQZk7Atq243zy6SMfOKK7LGLHQRgwjo+riZqIxnruWA1zLIDP8fbNtzP1GDfx1qlsXV3oPT6b/GR6srFYDGkhia+3JhDmVJwHEz7PMIhjiN2+0As8y+pQVAQ==',key_name='tempest-keypair-947392113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-e7ycnn43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162cc08b925a423caa2f868e93dffdee',uuid=2a9f7c8c-3c7a-4325-9738-badd6962d3a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:31:59 user nova-compute[74839]:   <uuid>2a9f7c8c-3c7a-4325-9738-badd6962d3a6</uuid>
Nov 18 15:31:59 user nova-compute[74839]:   <name>instance-00000004</name>
Nov 18 15:31:59 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:31:59 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:31:59 user nova-compute[74839]:   <metadata>
Nov 18 15:31:59 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:31:59 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1706783870</nova:name>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:31:59</nova:creationTime>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:31:59 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:31:59 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:owner>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:user uuid="162cc08b925a423caa2f868e93dffdee">tempest-VolumesAdminNegativeTest-375832265-project-member</nova:user>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:project uuid="262e132ce68d4ff9bfd9e25e9e0dd141">tempest-VolumesAdminNegativeTest-375832265</nova:project>
Nov 18 15:31:59 user nova-compute[74839]:       </nova:owner>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:31:59 user nova-compute[74839]:       <nova:ports>
Nov 18 15:31:59 user nova-compute[74839]:         <nova:port uuid="c306b011-a6ed-4eea-985f-1edac8cf46ee">
Nov 18 15:31:59 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 15:31:59 user nova-compute[74839]:         </nova:port>
Nov 18 15:31:59 user nova-compute[74839]:       </nova:ports>
Nov 18 15:31:59 user nova-compute[74839]:     </nova:instance>
Nov 18 15:31:59 user nova-compute[74839]:   </metadata>
Nov 18 15:31:59 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:31:59 user nova-compute[74839]:     <system>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="serial">2a9f7c8c-3c7a-4325-9738-badd6962d3a6</entry>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="uuid">2a9f7c8c-3c7a-4325-9738-badd6962d3a6</entry>
Nov 18 15:31:59 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:31:59 user nova-compute[74839]:     </system>
Nov 18 15:31:59 user nova-compute[74839]:   </sysinfo>
Nov 18 15:31:59 user nova-compute[74839]:   <os>
Nov 18 15:31:59 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:31:59 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:31:59 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:31:59 user nova-compute[74839]:   </os>
Nov 18 15:31:59 user nova-compute[74839]:   <features>
Nov 18 15:31:59 user nova-compute[74839]:     <acpi/>
Nov 18 15:31:59 user nova-compute[74839]:     <apic/>
Nov 18 15:31:59 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:31:59 user nova-compute[74839]:   </features>
Nov 18 15:31:59 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:31:59 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:31:59 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:31:59 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:31:59 user nova-compute[74839]:   </clock>
Nov 18 15:31:59 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:31:59 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:31:59 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:31:59 user nova-compute[74839]:   </cpu>
Nov 18 15:31:59 user nova-compute[74839]:   <devices>
Nov 18 15:31:59 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:31:59 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:31:59 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk"/>
Nov 18 15:31:59 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:31:59 user nova-compute[74839]:     </disk>
Nov 18 15:31:59 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:31:59 user nova-compute[74839]:       <mac address="fa:16:3e:9b:c3:fb"/>
Nov 18 15:31:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:59 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:31:59 user nova-compute[74839]:       <target dev="tapc306b011-a6"/>
Nov 18 15:31:59 user nova-compute[74839]:     </interface>
Nov 18 15:31:59 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:31:59 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/console.log" append="off"/>
Nov 18 15:31:59 user nova-compute[74839]:     </serial>
Nov 18 15:31:59 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:31:59 user nova-compute[74839]:     <video>
Nov 18 15:31:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:31:59 user nova-compute[74839]:     </video>
Nov 18 15:31:59 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:31:59 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:31:59 user nova-compute[74839]:     </rng>
Nov 18 15:31:59 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:31:59 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:31:59 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:31:59 user nova-compute[74839]:     </memballoon>
Nov 18 15:31:59 user nova-compute[74839]:   </devices>
Nov 18 15:31:59 user nova-compute[74839]: </domain>
Nov 18 15:31:59 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1706783870',display_name='tempest-VolumesAdminNegativeTest-server-1706783870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1706783870',id=4,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAdzlquspOQZk7Atq243zy6SMfOKK7LGLHQRgwjo+riZqIxnruWA1zLIDP8fbNtzP1GDfx1qlsXV3oPT6b/GR6srFYDGkhia+3JhDmVJwHEz7PMIhjiN2+0As8y+pQVAQ==',key_name='tempest-keypair-947392113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-e7ycnn43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162cc08b925a423caa2f868e93dffdee',uuid=2a9f7c8c-3c7a-4325-9738-badd6962d3a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG os_vif [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34a90786-ee28-5bd7-9e4e-d0bd9be1f9ba', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc306b011-a6, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc306b011-a6, col_values=(('qos', UUID('0802e3af-e707-438b-a448-5b8c78e684d8')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc306b011-a6, col_values=(('external_ids', {'iface-id': 'c306b011-a6ed-4eea-985f-1edac8cf46ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c3:fb', 'vm-uuid': '2a9f7c8c-3c7a-4325-9738-badd6962d3a6'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:31:59 user nova-compute[74839]: INFO os_vif [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6')
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:31:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No VIF found with MAC fa:16:3e:9b:c3:fb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] No waiting events found dispatching network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:00 user nova-compute[74839]: WARNING nova.compute.manager [req-f8f3959a-37f1-46b1-ac1e-60395e022f62 req-2ad86ab8-2c5b-4a45-80a6-18b5fe598607 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received unexpected event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce for instance with vm_state active and task_state None.
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG nova.network.neutron [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updated VIF entry in instance network info cache for port c306b011-a6ed-4eea-985f-1edac8cf46ee. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG nova.network.neutron [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-46846def-6a4b-4c6e-b9ac-40d8e1949e99 req-2aff9d16-2f42-4e07-8695-a215bd823dd7 service nova] Releasing lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] No waiting events found dispatching network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:02 user nova-compute[74839]: WARNING nova.compute.manager [req-2d7c7a2a-2dcc-4f0d-aad6-615b648b3d82 req-f312f302-e5c9-4897-9352-4b84a92d7768 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received unexpected event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce for instance with vm_state active and task_state None.
Nov 18 15:32:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:02 user nova-compute[74839]: INFO nova.compute.claims [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Claim successful on node user
Nov 18 15:32:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.955s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:32:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Creating image(s)
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "/opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "/opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "/opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.policy [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aa588cc9b9642a48c99d8338c651235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539debd6bd2f43b99eb36d50a5baab91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.239s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:32:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Instance spawned successfully.
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk 1073741824" returned: 0 in 0.060s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:04 user nova-compute[74839]: INFO nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Took 12.33 seconds to spawn the instance on the hypervisor.
Nov 18 15:32:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:32:05 user nova-compute[74839]: INFO nova.compute.manager [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Took 13.29 seconds to build instance.
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fcd826e6-a7a9-4f03-9a9b-7969897ba918 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.416s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.310s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Cannot resize image /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Ensure instance console log exists: /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Successfully created port: 68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:06 user nova-compute[74839]: INFO nova.compute.claims [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Claim successful on node user
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.policy [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82f9d6235e574da1b7f600431a508e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bed18c2a39944aca637c4cf993084f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] No waiting events found dispatching network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:07 user nova-compute[74839]: WARNING nova.compute.manager [req-1afa73fd-8402-480a-bf95-dcba215af733 req-b094ab71-002c-4b54-a22d-fa6add51ab66 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received unexpected event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee for instance with vm_state active and task_state None.
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:32:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Creating image(s)
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "/opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "/opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "/opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.340s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Successfully updated port: 68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquired lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-changed-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Refreshing instance network info cache due to event network-changed-68399f97-b18a-47c7-8146-12c90804cb6d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] Acquiring lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.249s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Successfully created port: 57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk 1073741824" returned: 0 in 0.061s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Cannot resize image /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Ensure instance console log exists: /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:08 user nova-compute[74839]: INFO nova.compute.claims [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Claim successful on node user
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updating instance_info_cache with network_info: [{"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Releasing lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Instance network_info: |[{"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] Acquired lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Refreshing network info cache for port 68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Start _get_guest_xml network_info=[{"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Successfully updated port: 57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquired lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-changed-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Refreshing instance network info cache due to event network-changed-57cb73b7-3769-484e-9ab8-24c8b8b26dcb. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] Acquiring lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-108973333',display_name='tempest-TestVolumeSwap-server-108973333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-108973333',id=5,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXk2ENJ/jNdXOucJMBtH05ArRrZN8dEKkJGTbFaTi+mJTgJ9eHnZCjONCrEb7O+QcQUhahh/qXP2JtvGyupsDGcUm1oqdhkHKO3shMcMa/lSJEtXgA5JiiRvEZV2y9JTg==',key_name='tempest-keypair-212807957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539debd6bd2f43b99eb36d50a5baab91',ramdisk_id='',reservation_id='r-t4oalpda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1822157254',owner_user_name='tempest-TestVolumeSwap-1822157254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aa588cc9b9642a48c99d8338c651235',uuid=4519ea92-d2c5-4871-a69e-fa50a3fcf6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converting VIF {"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.objects.instance [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lazy-loading 'pci_devices' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:32:09 user nova-compute[74839]:   <uuid>4519ea92-d2c5-4871-a69e-fa50a3fcf6de</uuid>
Nov 18 15:32:09 user nova-compute[74839]:   <name>instance-00000005</name>
Nov 18 15:32:09 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:32:09 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:32:09 user nova-compute[74839]:   <metadata>
Nov 18 15:32:09 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:32:09 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:name>tempest-TestVolumeSwap-server-108973333</nova:name>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:32:08</nova:creationTime>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:32:09 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:32:09 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:owner>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:user uuid="1aa588cc9b9642a48c99d8338c651235">tempest-TestVolumeSwap-1822157254-project-member</nova:user>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:project uuid="539debd6bd2f43b99eb36d50a5baab91">tempest-TestVolumeSwap-1822157254</nova:project>
Nov 18 15:32:09 user nova-compute[74839]:       </nova:owner>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:32:09 user nova-compute[74839]:       <nova:ports>
Nov 18 15:32:09 user nova-compute[74839]:         <nova:port uuid="68399f97-b18a-47c7-8146-12c90804cb6d">
Nov 18 15:32:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 15:32:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:32:09 user nova-compute[74839]:       </nova:ports>
Nov 18 15:32:09 user nova-compute[74839]:     </nova:instance>
Nov 18 15:32:09 user nova-compute[74839]:   </metadata>
Nov 18 15:32:09 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:32:09 user nova-compute[74839]:     <system>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="serial">4519ea92-d2c5-4871-a69e-fa50a3fcf6de</entry>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="uuid">4519ea92-d2c5-4871-a69e-fa50a3fcf6de</entry>
Nov 18 15:32:09 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:32:09 user nova-compute[74839]:     </system>
Nov 18 15:32:09 user nova-compute[74839]:   </sysinfo>
Nov 18 15:32:09 user nova-compute[74839]:   <os>
Nov 18 15:32:09 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:32:09 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:32:09 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:32:09 user nova-compute[74839]:   </os>
Nov 18 15:32:09 user nova-compute[74839]:   <features>
Nov 18 15:32:09 user nova-compute[74839]:     <acpi/>
Nov 18 15:32:09 user nova-compute[74839]:     <apic/>
Nov 18 15:32:09 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:32:09 user nova-compute[74839]:   </features>
Nov 18 15:32:09 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:32:09 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:32:09 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:32:09 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:32:09 user nova-compute[74839]:   </clock>
Nov 18 15:32:09 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:32:09 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:32:09 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:32:09 user nova-compute[74839]:   </cpu>
Nov 18 15:32:09 user nova-compute[74839]:   <devices>
Nov 18 15:32:09 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:32:09 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:32:09 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk"/>
Nov 18 15:32:09 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:32:09 user nova-compute[74839]:     </disk>
Nov 18 15:32:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:32:09 user nova-compute[74839]:       <mac address="fa:16:3e:5c:82:92"/>
Nov 18 15:32:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:32:09 user nova-compute[74839]:       <target dev="tap68399f97-b1"/>
Nov 18 15:32:09 user nova-compute[74839]:     </interface>
Nov 18 15:32:09 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:32:09 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/console.log" append="off"/>
Nov 18 15:32:09 user nova-compute[74839]:     </serial>
Nov 18 15:32:09 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:32:09 user nova-compute[74839]:     <video>
Nov 18 15:32:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:09 user nova-compute[74839]:     </video>
Nov 18 15:32:09 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:32:09 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:32:09 user nova-compute[74839]:     </rng>
Nov 18 15:32:09 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:32:09 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:32:09 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:32:09 user nova-compute[74839]:     </memballoon>
Nov 18 15:32:09 user nova-compute[74839]:   </devices>
Nov 18 15:32:09 user nova-compute[74839]: </domain>
Nov 18 15:32:09 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-108973333',display_name='tempest-TestVolumeSwap-server-108973333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-108973333',id=5,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXk2ENJ/jNdXOucJMBtH05ArRrZN8dEKkJGTbFaTi+mJTgJ9eHnZCjONCrEb7O+QcQUhahh/qXP2JtvGyupsDGcUm1oqdhkHKO3shMcMa/lSJEtXgA5JiiRvEZV2y9JTg==',key_name='tempest-keypair-212807957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='539debd6bd2f43b99eb36d50a5baab91',ramdisk_id='',reservation_id='r-t4oalpda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1822157254',owner_user_name='tempest-TestVolumeSwap-1822157254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aa588cc9b9642a48c99d8338c651235',uuid=4519ea92-d2c5-4871-a69e-fa50a3fcf6de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converting VIF {"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG os_vif [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b26cfc9-5ec1-5525-b277-978dfa8a3f15', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68399f97-b1, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68399f97-b1, col_values=(('qos', UUID('222db6a9-4830-444d-845e-5220daa28b34')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68399f97-b1, col_values=(('external_ids', {'iface-id': '68399f97-b18a-47c7-8146-12c90804cb6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:82:92', 'vm-uuid': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:09 user nova-compute[74839]: INFO os_vif [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1')
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] No VIF found with MAC fa:16:3e:5c:82:92, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] No waiting events found dispatching network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:09 user nova-compute[74839]: WARNING nova.compute.manager [req-4545225c-cf74-4ab8-abdc-945735a7bd9e req-dd12b1f2-8461-45b1-a60e-5b091a885f33 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received unexpected event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee for instance with vm_state active and task_state None.
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.policy [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe7d466f9dc44a25ace23c56a11982f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd5ad095b224b42b5e496ed9611ee44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating instance_info_cache with network_info: [{"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:32:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Creating image(s)
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "/opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "/opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "/opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Releasing lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Instance network_info: |[{"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] Acquired lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.network.neutron [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Refreshing network info cache for port 57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Start _get_guest_xml network_info=[{"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:32:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1090325979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1090325979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1090325979',id=6,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjsR2oXGyiZkIleQTgKCm4Q2/UNWGTd4B14WLtzMh/ULp+jyjku5wr0e8KTrfZL0EdKX7E/B+lkvPrVMmRL7yciYqXMH2r+Myr0c57MhHKKcWEW6JSD8RAcnxXIx5urSw==',key_name='tempest-keypair-156532242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bed18c2a39944aca637c4cf993084f7',ramdisk_id='',reservation_id='r-mx8le3rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1491695643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1491695643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82f9d6235e574da1b7f600431a508e42',uuid=25559075-a7fe-464c-a454-3c7cdd8c0f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converting VIF {"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lazy-loading 'pci_devices' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.349s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:32:10 user nova-compute[74839]:   <uuid>25559075-a7fe-464c-a454-3c7cdd8c0f51</uuid>
Nov 18 15:32:10 user nova-compute[74839]:   <name>instance-00000006</name>
Nov 18 15:32:10 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:32:10 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:32:10 user nova-compute[74839]:   <metadata>
Nov 18 15:32:10 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:32:10 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1090325979</nova:name>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:32:09</nova:creationTime>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:32:10 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:32:10 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:owner>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:user uuid="82f9d6235e574da1b7f600431a508e42">tempest-VolumesAssistedSnapshotsTest-1491695643-project-member</nova:user>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:project uuid="6bed18c2a39944aca637c4cf993084f7">tempest-VolumesAssistedSnapshotsTest-1491695643</nova:project>
Nov 18 15:32:10 user nova-compute[74839]:       </nova:owner>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:32:10 user nova-compute[74839]:       <nova:ports>
Nov 18 15:32:10 user nova-compute[74839]:         <nova:port uuid="57cb73b7-3769-484e-9ab8-24c8b8b26dcb">
Nov 18 15:32:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 15:32:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:32:10 user nova-compute[74839]:       </nova:ports>
Nov 18 15:32:10 user nova-compute[74839]:     </nova:instance>
Nov 18 15:32:10 user nova-compute[74839]:   </metadata>
Nov 18 15:32:10 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:32:10 user nova-compute[74839]:     <system>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="serial">25559075-a7fe-464c-a454-3c7cdd8c0f51</entry>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="uuid">25559075-a7fe-464c-a454-3c7cdd8c0f51</entry>
Nov 18 15:32:10 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:32:10 user nova-compute[74839]:     </system>
Nov 18 15:32:10 user nova-compute[74839]:   </sysinfo>
Nov 18 15:32:10 user nova-compute[74839]:   <os>
Nov 18 15:32:10 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:32:10 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:32:10 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:32:10 user nova-compute[74839]:   </os>
Nov 18 15:32:10 user nova-compute[74839]:   <features>
Nov 18 15:32:10 user nova-compute[74839]:     <acpi/>
Nov 18 15:32:10 user nova-compute[74839]:     <apic/>
Nov 18 15:32:10 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:32:10 user nova-compute[74839]:   </features>
Nov 18 15:32:10 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:32:10 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:32:10 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:32:10 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:32:10 user nova-compute[74839]:   </clock>
Nov 18 15:32:10 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:32:10 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:32:10 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:32:10 user nova-compute[74839]:   </cpu>
Nov 18 15:32:10 user nova-compute[74839]:   <devices>
Nov 18 15:32:10 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:32:10 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:32:10 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk"/>
Nov 18 15:32:10 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:32:10 user nova-compute[74839]:     </disk>
Nov 18 15:32:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:32:10 user nova-compute[74839]:       <mac address="fa:16:3e:b6:d1:40"/>
Nov 18 15:32:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:32:10 user nova-compute[74839]:       <target dev="tap57cb73b7-37"/>
Nov 18 15:32:10 user nova-compute[74839]:     </interface>
Nov 18 15:32:10 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:32:10 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/console.log" append="off"/>
Nov 18 15:32:10 user nova-compute[74839]:     </serial>
Nov 18 15:32:10 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:32:10 user nova-compute[74839]:     <video>
Nov 18 15:32:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:10 user nova-compute[74839]:     </video>
Nov 18 15:32:10 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:32:10 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:32:10 user nova-compute[74839]:     </rng>
Nov 18 15:32:10 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:32:10 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:32:10 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:32:10 user nova-compute[74839]:     </memballoon>
Nov 18 15:32:10 user nova-compute[74839]:   </devices>
Nov 18 15:32:10 user nova-compute[74839]: </domain>
Nov 18 15:32:10 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1090325979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1090325979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1090325979',id=6,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjsR2oXGyiZkIleQTgKCm4Q2/UNWGTd4B14WLtzMh/ULp+jyjku5wr0e8KTrfZL0EdKX7E/B+lkvPrVMmRL7yciYqXMH2r+Myr0c57MhHKKcWEW6JSD8RAcnxXIx5urSw==',key_name='tempest-keypair-156532242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bed18c2a39944aca637c4cf993084f7',ramdisk_id='',reservation_id='r-mx8le3rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1491695643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1491695643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82f9d6235e574da1b7f600431a508e42',uuid=25559075-a7fe-464c-a454-3c7cdd8c0f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converting VIF {"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG os_vif [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe9c46e1-f59c-586b-8853-abd4dfe26f20', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] No waiting events found dispatching network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:10 user nova-compute[74839]: WARNING nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received unexpected event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 for instance with vm_state active and task_state None.
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] No waiting events found dispatching network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:10 user nova-compute[74839]: WARNING nova.compute.manager [req-585df549-7685-412d-be3d-d4092499d0a0 req-0b796fb2-5973-4680-8c6e-192ef5d7c341 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received unexpected event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 for instance with vm_state active and task_state None.
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57cb73b7-37, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57cb73b7-37, col_values=(('qos', UUID('f450a783-9792-4184-b827-4b4907718394')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57cb73b7-37, col_values=(('external_ids', {'iface-id': '57cb73b7-3769-484e-9ab8-24c8b8b26dcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d1:40', 'vm-uuid': '25559075-a7fe-464c-a454-3c7cdd8c0f51'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updated VIF entry in instance network info cache for port 68399f97-b18a-47c7-8146-12c90804cb6d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updating instance_info_cache with network_info: [{"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-660a2c25-87fe-44a2-afd5-76218bec7972 req-60cdbdb3-a25d-4f5a-8849-1024389eff09 service nova] Releasing lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:10 user nova-compute[74839]: INFO os_vif [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37')
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.198s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk 1073741824" returned: 0 in 0.095s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] No VIF found with MAC fa:16:3e:b6:d1:40, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updated VIF entry in instance network info cache for port 57cb73b7-3769-484e-9ab8-24c8b8b26dcb. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating instance_info_cache with network_info: [{"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-199d5cf1-b60d-4536-803f-4e65a43c9647 req-00e96fce-7fe9-434c-aac6-c430341179b8 service nova] Releasing lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.250s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:32:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Cannot resize image /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Ensure instance console log exists: /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Successfully created port: f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Successfully updated port: f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquired lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-changed-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Refreshing instance network info cache due to event network-changed-f2991664-67e9-4da9-b5d6-9b2df66ede01. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] Acquiring lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:12 user nova-compute[74839]: INFO nova.compute.claims [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Claim successful on node user
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Updating instance_info_cache with network_info: [{"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Releasing lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Instance network_info: |[{"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] Acquired lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Refreshing network info cache for port f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Start _get_guest_xml network_info=[{"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312044643',display_name='tempest-VolumesActionsTest-instance-312044643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312044643',id=7,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dd5ad095b224b42b5e496ed9611ee44',ramdisk_id='',reservation_id='r-d8rgjt5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-568408303',owner_user_name='tempest-VolumesActionsTest-568408303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:10Z,user_data=None,user_id='fe7d466f9dc44a25ace23c56a11982f7',uuid=11ed3ee3-04c6-416f-a4ef-13aa849d8a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converting VIF {"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lazy-loading 'pci_devices' on Instance uuid 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:32:12 user nova-compute[74839]:   <uuid>11ed3ee3-04c6-416f-a4ef-13aa849d8a9e</uuid>
Nov 18 15:32:12 user nova-compute[74839]:   <name>instance-00000007</name>
Nov 18 15:32:12 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:32:12 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:32:12 user nova-compute[74839]:   <metadata>
Nov 18 15:32:12 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:32:12 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:name>tempest-VolumesActionsTest-instance-312044643</nova:name>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:32:12</nova:creationTime>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:32:12 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:32:12 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:owner>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:user uuid="fe7d466f9dc44a25ace23c56a11982f7">tempest-VolumesActionsTest-568408303-project-member</nova:user>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:project uuid="7dd5ad095b224b42b5e496ed9611ee44">tempest-VolumesActionsTest-568408303</nova:project>
Nov 18 15:32:12 user nova-compute[74839]:       </nova:owner>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:32:12 user nova-compute[74839]:       <nova:ports>
Nov 18 15:32:12 user nova-compute[74839]:         <nova:port uuid="f2991664-67e9-4da9-b5d6-9b2df66ede01">
Nov 18 15:32:12 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 15:32:12 user nova-compute[74839]:         </nova:port>
Nov 18 15:32:12 user nova-compute[74839]:       </nova:ports>
Nov 18 15:32:12 user nova-compute[74839]:     </nova:instance>
Nov 18 15:32:12 user nova-compute[74839]:   </metadata>
Nov 18 15:32:12 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:32:12 user nova-compute[74839]:     <system>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="serial">11ed3ee3-04c6-416f-a4ef-13aa849d8a9e</entry>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="uuid">11ed3ee3-04c6-416f-a4ef-13aa849d8a9e</entry>
Nov 18 15:32:12 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:32:12 user nova-compute[74839]:     </system>
Nov 18 15:32:12 user nova-compute[74839]:   </sysinfo>
Nov 18 15:32:12 user nova-compute[74839]:   <os>
Nov 18 15:32:12 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:32:12 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:32:12 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:32:12 user nova-compute[74839]:   </os>
Nov 18 15:32:12 user nova-compute[74839]:   <features>
Nov 18 15:32:12 user nova-compute[74839]:     <acpi/>
Nov 18 15:32:12 user nova-compute[74839]:     <apic/>
Nov 18 15:32:12 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:32:12 user nova-compute[74839]:   </features>
Nov 18 15:32:12 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:32:12 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:32:12 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:32:12 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:32:12 user nova-compute[74839]:   </clock>
Nov 18 15:32:12 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:32:12 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:32:12 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:32:12 user nova-compute[74839]:   </cpu>
Nov 18 15:32:12 user nova-compute[74839]:   <devices>
Nov 18 15:32:12 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:32:12 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:32:12 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk"/>
Nov 18 15:32:12 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:32:12 user nova-compute[74839]:     </disk>
Nov 18 15:32:12 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:32:12 user nova-compute[74839]:       <mac address="fa:16:3e:91:3e:dc"/>
Nov 18 15:32:12 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:12 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:32:12 user nova-compute[74839]:       <target dev="tapf2991664-67"/>
Nov 18 15:32:12 user nova-compute[74839]:     </interface>
Nov 18 15:32:12 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:32:12 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/console.log" append="off"/>
Nov 18 15:32:12 user nova-compute[74839]:     </serial>
Nov 18 15:32:12 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:32:12 user nova-compute[74839]:     <video>
Nov 18 15:32:12 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:12 user nova-compute[74839]:     </video>
Nov 18 15:32:12 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:32:12 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:32:12 user nova-compute[74839]:     </rng>
Nov 18 15:32:12 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:32:12 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:32:12 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:32:12 user nova-compute[74839]:     </memballoon>
Nov 18 15:32:12 user nova-compute[74839]:   </devices>
Nov 18 15:32:12 user nova-compute[74839]: </domain>
Nov 18 15:32:12 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312044643',display_name='tempest-VolumesActionsTest-instance-312044643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312044643',id=7,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dd5ad095b224b42b5e496ed9611ee44',ramdisk_id='',reservation_id='r-d8rgjt5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-568408303',owner_user_name='tempest-VolumesActionsTest-568408303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:10Z,user_data=None,user_id='fe7d466f9dc44a25ace23c56a11982f7',uuid=11ed3ee3-04c6-416f-a4ef-13aa849d8a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converting VIF {"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG os_vif [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b67cc7e7-5260-5bc6-928d-0a34c49229c1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2991664-67, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2991664-67, col_values=(('qos', UUID('da43a625-aa11-407c-abe0-99d34d65387f')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2991664-67, col_values=(('external_ids', {'iface-id': 'f2991664-67e9-4da9-b5d6-9b2df66ede01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:3e:dc', 'vm-uuid': '11ed3ee3-04c6-416f-a4ef-13aa849d8a9e'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:12 user nova-compute[74839]: INFO os_vif [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67')
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.policy [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c2f377a54cb47a492e284d02a4781d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84720179af9a446fa15a13fedf97ddee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:32:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] No VIF found with MAC fa:16:3e:91:3e:dc, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:32:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Creating image(s)
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.209s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Updated VIF entry in instance network info cache for port f2991664-67e9-4da9-b5d6-9b2df66ede01. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Updating instance_info_cache with network_info: [{"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f83e242-760d-4f9e-97c5-04dd6ac72730 req-11b8d615-ccfd-4d85-b86a-abcd829ff71a service nova] Releasing lock "refresh_cache-11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk 1073741824" returned: 0 in 0.062s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Cannot resize image /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Ensure instance console log exists: /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Successfully created port: fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] No waiting events found dispatching network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:14 user nova-compute[74839]: WARNING nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received unexpected event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb for instance with vm_state building and task_state spawning.
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] No waiting events found dispatching network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:14 user nova-compute[74839]: WARNING nova.compute.manager [req-88fd1b92-4b97-4a70-abdb-b6636189b6c2 req-10d5feaf-a312-4c09-bf76-c8ce33bc9c1e service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received unexpected event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb for instance with vm_state building and task_state spawning.
Nov 18 15:32:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Successfully updated port: fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-changed-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing instance network info cache due to event network-changed-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Instance network_info: |[{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing network info cache for port fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Start _get_guest_xml network_info=[{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.objects.instance [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:32:15 user nova-compute[74839]:   <uuid>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</uuid>
Nov 18 15:32:15 user nova-compute[74839]:   <name>instance-00000008</name>
Nov 18 15:32:15 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:32:15 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:32:15 user nova-compute[74839]:   <metadata>
Nov 18 15:32:15 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:32:15 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:name>tempest-device-tagging-server-178092732</nova:name>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:32:15</nova:creationTime>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:32:15 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:32:15 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:owner>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:user uuid="5c2f377a54cb47a492e284d02a4781d4">tempest-TaggedAttachmentsTest-2005585609-project-member</nova:user>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:project uuid="84720179af9a446fa15a13fedf97ddee">tempest-TaggedAttachmentsTest-2005585609</nova:project>
Nov 18 15:32:15 user nova-compute[74839]:       </nova:owner>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:32:15 user nova-compute[74839]:       <nova:ports>
Nov 18 15:32:15 user nova-compute[74839]:         <nova:port uuid="fc17681d-3b08-4bd1-9d73-53a7b9d3cda4">
Nov 18 15:32:15 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:32:15 user nova-compute[74839]:         </nova:port>
Nov 18 15:32:15 user nova-compute[74839]:       </nova:ports>
Nov 18 15:32:15 user nova-compute[74839]:     </nova:instance>
Nov 18 15:32:15 user nova-compute[74839]:   </metadata>
Nov 18 15:32:15 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:32:15 user nova-compute[74839]:     <system>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="serial">59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="uuid">59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:32:15 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:32:15 user nova-compute[74839]:     </system>
Nov 18 15:32:15 user nova-compute[74839]:   </sysinfo>
Nov 18 15:32:15 user nova-compute[74839]:   <os>
Nov 18 15:32:15 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:32:15 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:32:15 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:32:15 user nova-compute[74839]:   </os>
Nov 18 15:32:15 user nova-compute[74839]:   <features>
Nov 18 15:32:15 user nova-compute[74839]:     <acpi/>
Nov 18 15:32:15 user nova-compute[74839]:     <apic/>
Nov 18 15:32:15 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:32:15 user nova-compute[74839]:   </features>
Nov 18 15:32:15 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:32:15 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:32:15 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:32:15 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:32:15 user nova-compute[74839]:   </clock>
Nov 18 15:32:15 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:32:15 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:32:15 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:32:15 user nova-compute[74839]:   </cpu>
Nov 18 15:32:15 user nova-compute[74839]:   <devices>
Nov 18 15:32:15 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:32:15 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:32:15 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk"/>
Nov 18 15:32:15 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:32:15 user nova-compute[74839]:     </disk>
Nov 18 15:32:15 user nova-compute[74839]:     <disk type="file" device="cdrom">
Nov 18 15:32:15 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 15:32:15 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config"/>
Nov 18 15:32:15 user nova-compute[74839]:       <target dev="hda" bus="ide"/>
Nov 18 15:32:15 user nova-compute[74839]:     </disk>
Nov 18 15:32:15 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:32:15 user nova-compute[74839]:       <mac address="fa:16:3e:1d:12:ab"/>
Nov 18 15:32:15 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:15 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:32:15 user nova-compute[74839]:       <target dev="tapfc17681d-3b"/>
Nov 18 15:32:15 user nova-compute[74839]:     </interface>
Nov 18 15:32:15 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:32:15 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log" append="off"/>
Nov 18 15:32:15 user nova-compute[74839]:     </serial>
Nov 18 15:32:15 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:32:15 user nova-compute[74839]:     <video>
Nov 18 15:32:15 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:32:15 user nova-compute[74839]:     </video>
Nov 18 15:32:15 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:32:15 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:32:15 user nova-compute[74839]:     </rng>
Nov 18 15:32:15 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:32:15 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:32:15 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:32:15 user nova-compute[74839]:     </memballoon>
Nov 18 15:32:15 user nova-compute[74839]:   </devices>
Nov 18 15:32:15 user nova-compute[74839]: </domain>
Nov 18 15:32:15 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG os_vif [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7da2b647-d694-5da5-b520-07717285c988', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc17681d-3b, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc17681d-3b, col_values=(('qos', UUID('3dd9a3ec-fcfc-44f2-8397-66853bfea610')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc17681d-3b, col_values=(('external_ids', {'iface-id': 'fc17681d-3b08-4bd1-9d73-53a7b9d3cda4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:12:ab', 'vm-uuid': '59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:15 user nova-compute[74839]: INFO os_vif [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b')
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:32:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Instance spawned successfully.
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name hda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No VIF found with MAC fa:16:3e:1d:12:ab, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:32:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Using config drive
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:15 user nova-compute[74839]: INFO nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Took 11.41 seconds to spawn the instance on the hypervisor.
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:32:15 user nova-compute[74839]: INFO nova.compute.manager [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Took 12.95 seconds to build instance.
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updated VIF entry in instance network info cache for port fc17681d-3b08-4bd1-9d73-53a7b9d3cda4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac595257-2fc0-447e-bdeb-59b88cda10bf req-c38e316c-5988-4972-ae22-2c978ee224cc service nova] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-032af94c-bdf6-4c9e-9a49-3d08ac61e5c3 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.274s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Creating config drive at /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvt11pd2o {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvt11pd2o" returned: 0 in 0.067s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] No waiting events found dispatching network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:16 user nova-compute[74839]: WARNING nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received unexpected event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 for instance with vm_state building and task_state spawning.
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] No waiting events found dispatching network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:16 user nova-compute[74839]: WARNING nova.compute.manager [req-f88a555e-1dcc-4d31-a24e-4a2aba50a25c req-b8765c4f-912f-4eac-bc49-6bf03827e83a service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received unexpected event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 for instance with vm_state building and task_state spawning.
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] No waiting events found dispatching network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:16 user nova-compute[74839]: WARNING nova.compute.manager [req-c0530ba6-7648-49fc-a2d2-5694e2017317 req-5a0f5cea-1a00-4040-85f7-03b8e72a309a service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received unexpected event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d for instance with vm_state active and task_state None.
Nov 18 15:32:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Instance spawned successfully.
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:16 user nova-compute[74839]: INFO nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Took 9.23 seconds to spawn the instance on the hypervisor.
Nov 18 15:32:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:32:16 user nova-compute[74839]: INFO nova.compute.manager [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Took 10.52 seconds to build instance.
Nov 18 15:32:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f5bb061-d093-4348-8099-c25cb4cad4a1 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.751s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:32:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Instance spawned successfully.
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:17 user nova-compute[74839]: INFO nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 18 15:32:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:32:17 user nova-compute[74839]: INFO nova.compute.manager [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Took 8.78 seconds to build instance.
Nov 18 15:32:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8b942440-69a9-4885-9d71-33cfb6b74499 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.129s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:18 user nova-compute[74839]: WARNING nova.compute.manager [req-5cacefa9-7d83-4413-9404-fd0f30b408c5 req-1e204730-bb9a-427d-ae56-89cfdc602b71 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 for instance with vm_state building and task_state spawning.
Nov 18 15:32:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] No waiting events found dispatching network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:18 user nova-compute[74839]: WARNING nova.compute.manager [req-dbd0f939-d80a-4d81-8277-b9ac310e2193 req-2b007021-1dd0-413e-8e02-b3ac5f27b8fd service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received unexpected event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d for instance with vm_state active and task_state None.
Nov 18 15:32:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:20 user nova-compute[74839]: WARNING nova.compute.manager [req-6c4e1b38-2cc7-46bc-be86-f1f47e11c734 req-a53f3bab-92e9-4845-a69d-551b984ecd14 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 for instance with vm_state building and task_state spawning.
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:20 user nova-compute[74839]: WARNING nova.compute.manager [req-86d76bf1-89a2-45da-8f0f-dd108d781ebf req-c8f33faa-da31-4693-ab11-f0363957d6ef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state active and task_state None.
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:32:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Instance spawned successfully.
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:32:21 user nova-compute[74839]: INFO nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Took 8.02 seconds to spawn the instance on the hypervisor.
Nov 18 15:32:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:32:21 user nova-compute[74839]: INFO nova.compute.manager [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Took 9.17 seconds to build instance.
Nov 18 15:32:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-665cebd9-8c14-4a8f-a216-d3af93268ced tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.290s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:32:22 user nova-compute[74839]: WARNING nova.compute.manager [req-db21332b-441f-455f-89fb-d8481b3e1d21 req-c17e9cc4-146e-4e1c-ae35-8535d5677821 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state active and task_state None.
Nov 18 15:32:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:32:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:32:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:32:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:32:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:32 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:33 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:38 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:38 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.77730941772461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 3e387d43-67cf-453c-bc42-b1b380d18dee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 21d73872-2b83-48b1-b465-9309a293ad81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:32:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:32:39 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:39 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:39 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:32:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.858s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:41 user nova-compute[74839]: INFO nova.compute.claims [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Claim successful on node user
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:41 user nova-compute[74839]: INFO nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Booting with volume e2c2a31c-23f9-4372-8356-f741e21cfa2b at /dev/vda
Nov 18 15:32:41 user nova-compute[74839]: DEBUG nova.policy [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12be125ca9d848a3ad3a5ff48749ebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d158b075964d93aac7e73c22af57f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:41 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_0c2d2xx/privsep.sock']
Nov 18 15:32:41 user sudo[85733]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_0c2d2xx/privsep.sock
Nov 18 15:32:41 user sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 18 15:32:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully created port: 1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully created port: 7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:32:43 user sudo[85733]: pam_unix(sudo:session): session closed for user root
Nov 18 15:32:43 user nova-compute[74839]: INFO oslo.privsep.daemon [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Spawned new privsep daemon via rootwrap
Nov 18 15:32:43 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 18 15:32:43 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 18 15:32:43 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 18 15:32:43 user nova-compute[74839]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85739
Nov 18 15:32:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393dda1-4198-477f-b6ca-c940c9a8ef7b]: (2,) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:32:44 user nova-compute[74839]: INFO nova.compute.claims [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Claim successful on node user
Nov 18 15:32:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b518551d-d448-478b-b0cb-931e51004e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: WARNING os_brick.initiator.connectors.nvmeof [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf5991e-24d2-42c1-91dd-718206980356]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[65704f14-aeea-423d-934d-0424b2487e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b348d3c-255a-41d9-8589-5a40095faa3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:44 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd860f95-b13b-416e-a096-8124a647d31c]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== get_connector_properties: return (2408ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating existing volume attachment record: c6f94268-efe6-4481-a16c-15314d4f0553 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:32:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully created port: f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:32:44 user nova-compute[74839]: INFO nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Booting with volume 2096dd89-b364-4dc2-b3ef-17073a061ff8 at /dev/vda
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG nova.policy [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bda38a528344edfacaea3420375bd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42d52c8758e845d2843372cf46d8546f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57ed010-e93f-4f0e-a2bf-203df96c04ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcc7d69-b546-4c9b-8dff-01b75485aa8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1228fefc-8be4-47f2-8873-561290063c78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b7075d-e131-4a34-91f2-23327c2718aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:45 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771f38e-c36d-426f-a36d-3262e0c805cf]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating existing volume attachment record: 42f4dd55-274f-48e6-9d69-0a68838ab480 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully created port: 3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully created port: a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully created port: 1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully created port: 6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-1c117963-6a73-43d6-9664-2b5afab2f3e6. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.network.neutron [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:46 user nova-compute[74839]: DEBUG nova.network.neutron [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully created port: 58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6672a5f1-fe9a-4fb0-b97c-0d2cfcba25ac req-fc3d5a01-dbee-410b-b2d2-8daf050f8bd6 service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully created port: 159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully created port: 88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-1771be62-4c19-4faa-aaf9-060fd0cc4d6c. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-76f43e4e-63ba-4d7c-baba-2d432f08c163. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:48 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-7ee14998-eac8-4462-90a5-97eb5c541f74. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a340f15-6558-40fe-bf2c-25606eeb7e9c req-ac8be636-d84d-4280-910e-3a58486f011a service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c3d90491-5398-47eb-9270-7b74a7236633 req-5c4015be-e6e0-45bb-ae8f-e8c484aee2bb service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:50 user nova-compute[74839]: INFO nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Booting with volume 3997f816-5517-44aa-a81c-dfe68faddadc at /dev/vdb
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e0355-2d2a-4052-94fa-5d0e6b7339c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[056dcf39-0699-454e-b271-c5d98111b666]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1e4258-9071-454a-8f5f-ce3cb288bc0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f34f44-aa23-43be-8678-a68603862113]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Successfully updated port: 1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-f23cd7a1-c7a6-4973-ac87-48bd723eee21. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:50 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af0be93-86db-4a09-8d15-606da96e376f]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating existing volume attachment record: 6c86615f-2137-41fd-ad64-2fa6634124d5 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-3df99199-a24f-40f4-8fad-31b223c6a1b1. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:51 user nova-compute[74839]: INFO nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Booting with volume 8db7a105-c54d-4b95-997c-58b5b33fd9a0 at /dev/vdb
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-3a76d87f-373b-41bc-bbb7-e2c50dacd409. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaca9f5-40d6-4faa-8205-ff0d5d5300bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f6b753-6f6a-4640-80c4-52b55d559720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52bb7eb-3c39-4fe2-9085-9d996b680cc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c5412-7ac4-4daf-b4bc-703274974623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:51 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cda05bc-d8f0-4987-9e0c-99f717882115]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating existing volume attachment record: 736a2bbe-9307-42a8-a01f-3547b8c6050d {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50cc6a1d-2024-4f0f-98a8-fad78544555a req-f3a441ff-7c5a-4d63-83ae-710702d696f8 service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-7378ff76-aa38-48cb-b2fa-9ff658b7b442. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-808088f5-1ec8-454e-88c9-27377fe30292 req-4d6391f2-802b-4c03-a763-2b7fc53d03d1 service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-1f9ee567-317a-4ded-93be-9ff37424298f. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance network_info: |[{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updated VIF entry in instance network info cache for port 1f9ee567-317a-4ded-93be-9ff37424298f. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0e50a61c-6f64-437d-9186-af43343ca132 req-c1e4bf5c-1850-43bc-b714-2480bd30a479 service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-58f6b00a-0e4c-4994-9ef6-8c1f5800def3. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bbe040df-acb9-4542-829f-22f4284c385d req-f5f49cbc-1b49-499c-b143-4f29abb8effb service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Successfully updated port: 88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-159f3b98-181b-482b-9ad0-116dc5f76d13. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:56 user nova-compute[74839]: INFO nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Booting with volume a690a23e-e83d-4b05-bd7d-116a0086c7ad at /dev/vdc
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[883211ae-cf7f-4fe5-8289-dbe119de76e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdddf07-7282-441e-ac19-ded638015b56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7122ce-79ad-4ec3-af71-797bf81f6043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d3545f-75ea-4108-85af-63aad49e6a4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:56 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9c72e4-0ccc-4991-bc4e-6e6519158f98]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG os_brick.utils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:56 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating existing volume attachment record: f7dcaaae-2edc-4fa9-b903-0608292f5762 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.network.neutron [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance network_info: |[{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:57 user nova-compute[74839]: INFO nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Booting with volume aa6240e7-e65e-40b8-b7a7-4396f256b5c2 at /dev/vdc
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d919f-fae4-47ec-ade1-4641f6b08c63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a9e11-19bf-4a1d-8d55-eb2df08f4453]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.011s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3b946-5e88-4e09-92b8-b2e7a51cb646]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d841d2d-e111-4c4f-94af-9e6477e21132]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updated VIF entry in instance network info cache for port 159f3b98-181b-482b-9ad0-116dc5f76d13. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-88d03611-96cb-4927-851a-793c6b99935d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port 88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:32:57 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:32:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71c67c-74ca-418e-a165-346bfd6f0565]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG os_brick.utils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:32:57 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating existing volume attachment record: f0a45e56-6b10-4fde-a59a-d00d96e8f67e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:32:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updated VIF entry in instance network info cache for port 88d03611-96cb-4927-851a-793c6b99935d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:32:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:32:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f4ab7503-0945-4262-8219-343f8ee0c468 req-1b4f0fd0-96b8-41b6-ac2b-14232bb04d37 service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:33:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Creating image(s)
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Ensure instance console log exists: /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Start _get_guest_xml network_info=[{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c6f94268-efe6-4481-a16c-15314d4f0553', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keWwIAxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2c2a31c-23f9-4372-8356-f741e21cfa2b', 'serial': 'e2c2a31c-23f9-4372-8356-f741e21cfa2b'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '6c86615f-2137-41fd-ad64-2fa6634124d5', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQPnetBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7', 'attached_at': '', 'detached_at': '', 'volume_id': '3997f816-5517-44aa-a81c-dfe68faddadc', 'serial': '3997f816-5517-44aa-a81c-dfe68faddadc'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'f7dcaaae-2edc-4fa9-b903-0608292f5762', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHuDcIiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a690a23e-e83d-4b05-bd7d-116a0086c7ad', 'serial': 'a690a23e-e83d-4b05-bd7d-116a0086c7ad'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:33:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connector [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Factory for ISCSI on None {{(pid=74839) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keWwIAxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:02 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:02 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:02 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784fc94-de04-407d-81d5-287e52627ee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:02 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5987646-c060-4db7-9316-c06a025e428e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b] added
Nov 18 15:33:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc6b95-2a62-43e4-9d34-1f99edc4f097]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[295fc5bd-dd69-4b65-9a7e-e37ca7fc49b7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keWwIAxs {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keWwIAxs" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0871e1-7dff-4bcc-a121-4b84c64d8bf7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'keWwIAxs'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[44930f0b-d206-4d73-8930-166781db5e3a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ddf28d-ac3e-4013-b68e-f4600fc93b97]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:33:02 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:33:02 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:02 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:33:02 user nova-compute[74839]: 
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9e3443-8651-4ddc-a12f-2ab85f6f3819]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260]
Nov 18 15:33:02 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a000f0-c9f6-4eef-a186-297467def22b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395d314-803c-4e49-af2e-4aed6cccb9e0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab3ee0-657f-4410-bc13-78c5cbba5493]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keWwIAxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:33:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Creating image(s)
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Ensure instance console log exists: /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Start _get_guest_xml network_info=[{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '42f4dd55-274f-48e6-9d69-0a68838ab480', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLvzDmxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e80441a-5c23-490f-8fe3-fde7ca91270a', 'attached_at': '', 'detached_at': '', 'volume_id': '2096dd89-b364-4dc2-b3ef-17073a061ff8', 'serial': '2096dd89-b364-4dc2-b3ef-17073a061ff8'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '736a2bbe-9307-42a8-a01f-3547b8c6050d', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nANLIZjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e80441a-5c23-490f-8fe3-fde7ca91270a', 'attached_at': '', 'detached_at': '', 'volume_id': '8db7a105-c54d-4b95-997c-58b5b33fd9a0', 'serial': '8db7a105-c54d-4b95-997c-58b5b33fd9a0'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'f0a45e56-6b10-4fde-a59a-d00d96e8f67e', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIgNAwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e80441a-5c23-490f-8fe3-fde7ca91270a', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 'serial': 'aa6240e7-e65e-40b8-b7a7-4396f256b5c2'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:33:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLvzDmxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26262613661316666', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262613661316666', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.720s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:03 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3a3e5-395c-4344-82f4-ccffea228d4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:03 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQPnetBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7288f9e-a66d-4405-881c-6d8d0c6c5424]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8] added
Nov 18 15:33:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f546c82-5fc6-4ca3-8a54-12ff9c408b42]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386386c-d0f3-4182-9dcf-c9c948390f6c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kLvzDmxO {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kLvzDmxO" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe08694-7817-4d84-a6a5-76956b6aeecf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kLvzDmxO'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e35093b-9851-4e60-9017-45b78a0fe07a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d631c7-5852-48b7-9c9d-356a5be60798]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8f0efa-277e-4a4b-8432-23a1705f74a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260]
Nov 18 15:33:04 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:04 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a1d21c-3d9d-4d78-9e03-f7e781c000da]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[14955d9d-ec15-4abc-8001-59ab3b64fb34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:04 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:04 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:04 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:04 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4461d926-6390-45c4-9c74-174b27ba0375]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:04 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLvzDmxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== connect_volume: return (2000ms) {'type': 'block', 'scsi_wwn': '26531613962653065', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531613962653065', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.255s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:05 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:05 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a5893-1ecb-4155-9bd8-a468dbea77de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:05 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nANLIZjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:05 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[48adc3be-a183-47e1-9f74-f6ee5818e5dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc] added
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df52b46-bbbb-4de3-9346-d837a839f89f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd29d1e-db16-49ce-806a-e9cd19fc20fd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQPnetBV {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQPnetBV" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4519984-9316-4840-88b9-a44ceeffc404]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQPnetBV'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13de4b30-ebca-4cde-9f67-63b3d640a8fd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220b773-4e2d-4903-a288-9973f3cd3e35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4e8bd5-787a-46fe-a683-bd3bb7c6f7d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260]
Nov 18 15:33:05 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d98c0a-933d-48ea-9f69-3710c9a599a7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f39056-169d-44c3-bc96-275dd90d46ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:05 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77098d2e-0e1b-4ffa-b8e7-bf2376feb966]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQPnetBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:33:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== connect_volume: return (2535ms) {'type': 'block', 'scsi_wwn': '23831643138373963', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831643138373963', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.256s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:06 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:06 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b2bf4-f059-4180-a2d7-fc6bcea74a81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:06 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHuDcIiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:06 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26405a8-8eda-4c05-bacc-97548a53a993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0] added
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[313303a7-f018-4681-9639-8d12186556cf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[339b28ec-81e4-48b6-94de-b92a469eb7cf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nANLIZjF {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nANLIZjF" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18813c32-9ff8-40fc-bfbc-baa979ad4fe3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nANLIZjF'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b79716-16e4-43f3-b13a-0ff13306453b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9435281a-fe6b-4f79-8b1c-8a119a48fcb8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b47057-8b9e-4c49-83b4-3a2047c66d50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260]
Nov 18 15:33:06 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec239a4e-f3e2-47c1-8d60-de341a6e7b44]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6972a1bf-b04d-42d1-898b-0952108e4fe9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:06 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28a0b05-f742-48f7-b661-baa8267fc070]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nANLIZjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== connect_volume: return (2556ms) {'type': 'block', 'scsi_wwn': '23763376134373363', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763376134373363', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:07 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:07 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461babd-f7f7-46ac-9e88-49918d33f899]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:07 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIgNAwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:07 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa68644-d693-41ab-9191-1d8ec8c3248b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad] added
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c2e1a5-de8c-4173-9585-41964ee4bb92]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10637da4-eb45-4af4-a5ec-db8b912f3ef7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHuDcIiR {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHuDcIiR" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e32b21-a972-439c-a2be-a44a130889a9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bHuDcIiR'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[928da7cf-65b3-4513-b7eb-55268ccb7bfd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a291bf-cbb6-400c-b447-017975d536a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd714af-0df3-4338-bb44-8a3e9de61a0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260]
Nov 18 15:33:07 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ab51da-b9e1-4dae-a868-30f3e60b3149]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578ad04-1496-4c7d-85af-db7cca524ca8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:07 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0345fc5-5609-461c-8652-9c779268a419]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHuDcIiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== connect_volume: return (2576ms) {'type': 'block', 'scsi_wwn': '26361323134633136', 'path': '/dev/sdf'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361323134633136', 'path': '/dev/sdf'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.278s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:08 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eee4bc-d864-4bb2-870a-d3c748bd259f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:09 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.objects.instance [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ada6b7-15c3-4799-8c4c-10fe09ec5138]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2] added
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:33:09 user nova-compute[74839]:   <uuid>8ffe39c0-2f69-4ab4-bcf0-548f93b231a7</uuid>
Nov 18 15:33:09 user nova-compute[74839]:   <name>instance-00000009</name>
Nov 18 15:33:09 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:33:09 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:33:09 user nova-compute[74839]:   <metadata>
Nov 18 15:33:09 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:33:09 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:name>tempest-device-tagging-server-2023976883</nova:name>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:33:02</nova:creationTime>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:33:09 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:33:09 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:owner>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:user uuid="12be125ca9d848a3ad3a5ff48749ebcb">tempest-TaggedBootDevicesTest-813747827-project-member</nova:user>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:project uuid="56d158b075964d93aac7e73c22af57f6">tempest-TaggedBootDevicesTest-813747827</nova:project>
Nov 18 15:33:09 user nova-compute[74839]:       </nova:owner>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:33:09 user nova-compute[74839]:       <nova:ports>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="1c117963-6a73-43d6-9664-2b5afab2f3e6">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="1771be62-4c19-4faa-aaf9-060fd0cc4d6c">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="76f43e4e-63ba-4d7c-baba-2d432f08c163">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="7ee14998-eac8-4462-90a5-97eb5c541f74">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="f23cd7a1-c7a6-4973-ac87-48bd723eee21">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="3df99199-a24f-40f4-8fad-31b223c6a1b1">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:         <nova:port uuid="1f9ee567-317a-4ded-93be-9ff37424298f">
Nov 18 15:33:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 15:33:09 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:09 user nova-compute[74839]:       </nova:ports>
Nov 18 15:33:09 user nova-compute[74839]:     </nova:instance>
Nov 18 15:33:09 user nova-compute[74839]:   </metadata>
Nov 18 15:33:09 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:33:09 user nova-compute[74839]:     <system>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="serial">8ffe39c0-2f69-4ab4-bcf0-548f93b231a7</entry>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="uuid">8ffe39c0-2f69-4ab4-bcf0-548f93b231a7</entry>
Nov 18 15:33:09 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:33:09 user nova-compute[74839]:     </system>
Nov 18 15:33:09 user nova-compute[74839]:   </sysinfo>
Nov 18 15:33:09 user nova-compute[74839]:   <os>
Nov 18 15:33:09 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:33:09 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:33:09 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:33:09 user nova-compute[74839]:   </os>
Nov 18 15:33:09 user nova-compute[74839]:   <features>
Nov 18 15:33:09 user nova-compute[74839]:     <acpi/>
Nov 18 15:33:09 user nova-compute[74839]:     <apic/>
Nov 18 15:33:09 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:33:09 user nova-compute[74839]:   </features>
Nov 18 15:33:09 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:33:09 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:33:09 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:33:09 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:33:09 user nova-compute[74839]:   </clock>
Nov 18 15:33:09 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:33:09 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:33:09 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:33:09 user nova-compute[74839]:   </cpu>
Nov 18 15:33:09 user nova-compute[74839]:   <devices>
Nov 18 15:33:09 user nova-compute[74839]:     <disk type="file" device="cdrom">
Nov 18 15:33:09 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 15:33:09 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/disk.config"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="hda" bus="ide"/>
Nov 18 15:33:09 user nova-compute[74839]:     </disk>
Nov 18 15:33:09 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:09 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:09 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <serial>e2c2a31c-23f9-4372-8356-f741e21cfa2b</serial>
Nov 18 15:33:09 user nova-compute[74839]:     </disk>
Nov 18 15:33:09 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:09 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:09 user nova-compute[74839]:       <source dev="/dev/sdd"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <serial>3997f816-5517-44aa-a81c-dfe68faddadc</serial>
Nov 18 15:33:09 user nova-compute[74839]:     </disk>
Nov 18 15:33:09 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:09 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:09 user nova-compute[74839]:       <source dev="/dev/sdf"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="vdc" bus="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <serial>a690a23e-e83d-4b05-bd7d-116a0086c7ad</serial>
Nov 18 15:33:09 user nova-compute[74839]:     </disk>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:f1:e3:29"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap1c117963-6a"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:b0:7c:e2"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap1771be62-4c"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:7e:60:f9"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap76f43e4e-63"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:44:93:56"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap7ee14998-ea"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:58:99:1c"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tapf23cd7a1-c7"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:9a:9d:4b"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap3df99199-a2"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:09 user nova-compute[74839]:       <mac address="fa:16:3e:7d:78:1a"/>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:09 user nova-compute[74839]:       <target dev="tap1f9ee567-31"/>
Nov 18 15:33:09 user nova-compute[74839]:     </interface>
Nov 18 15:33:09 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:33:09 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/console.log" append="off"/>
Nov 18 15:33:09 user nova-compute[74839]:     </serial>
Nov 18 15:33:09 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:33:09 user nova-compute[74839]:     <video>
Nov 18 15:33:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:09 user nova-compute[74839]:     </video>
Nov 18 15:33:09 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:33:09 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:33:09 user nova-compute[74839]:     </rng>
Nov 18 15:33:09 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:33:09 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:33:09 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:33:09 user nova-compute[74839]:     </memballoon>
Nov 18 15:33:09 user nova-compute[74839]:   </devices>
Nov 18 15:33:09 user nova-compute[74839]: </domain>
Nov 18 15:33:09 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07e7f3fc-92a5-5dcc-8ab0-17cb66864993', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7285cae-4aac-4718-b210-fdb0c0772032]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c117963-6a, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c117963-6a, col_values=(('qos', UUID('9eae372a-fe44-4ea4-83aa-a06d3b69b1ec')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c117963-6a, col_values=(('external_ids', {'iface-id': '1c117963-6a73-43d6-9664-2b5afab2f3e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:e3:29', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d7ae69-3c8c-4a58-8246-e83176d50275]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIgNAwJB {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd002d00a-9d7c-517c-870d-8b12cba110f9', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIgNAwJB" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5aa461-8b72-4471-bfd7-edfe1bb1b98a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PIgNAwJB'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1771be62-4c, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1771be62-4c, col_values=(('qos', UUID('02dd5118-ca83-452a-82a2-10dad0ea851e')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1771be62-4c, col_values=(('external_ids', {'iface-id': '1771be62-4c19-4faa-aaf9-060fd0cc4d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:7c:e2', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d5498-46d5-4d4c-bd73-90b7f5b58fcd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c5fc5ad-9037-53ae-86d3-d099aea3ccec', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913045d-6ad0-40f9-8ba7-de5e31aaa926]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76f43e4e-63, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76f43e4e-63, col_values=(('qos', UUID('2f652696-a0f0-4c7c-baa1-06ad82fecc0d')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76f43e4e-63, col_values=(('external_ids', {'iface-id': '76f43e4e-63ba-4d7c-baba-2d432f08c163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:60:f9', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '763515b5-c5f9-519d-8625-51a24a8dd2b1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21841c1c-9b92-4c48-82d0-828936455561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260]
Nov 18 15:33:09 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee14998-ea, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ee14998-ea, col_values=(('qos', UUID('2b227936-d910-4a4a-99ea-8127c8176669')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ee14998-ea, col_values=(('external_ids', {'iface-id': '7ee14998-eac8-4462-90a5-97eb5c541f74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:93:56', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07479a-7b71-4b96-9008-bda353a27cf4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4140227e-1a0d-48de-9081-9b18c54a2386]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:09 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1658e7cd-054b-52f7-9cd9-66b873d1c159', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e3b7a-ee31-4573-b637-47686429e7f9]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf23cd7a1-c7, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf23cd7a1-c7, col_values=(('qos', UUID('e8a20994-30a9-474c-81b6-3b5ce3ca145a')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf23cd7a1-c7, col_values=(('external_ids', {'iface-id': 'f23cd7a1-c7a6-4973-ac87-48bd723eee21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:99:1c', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '846519f8-f1af-5671-b2ec-dca733cf6dfb', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3df99199-a2, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3df99199-a2, col_values=(('qos', UUID('2eec9af0-2b92-4eff-828c-f286ce839bdd')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3df99199-a2, col_values=(('external_ids', {'iface-id': '3df99199-a24f-40f4-8fad-31b223c6a1b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:9d:4b', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06a778fd-da09-5a71-87f8-b5270fa13d67', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f9ee567-31, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f9ee567-31, col_values=(('qos', UUID('e8862520-aaec-4a32-9f0f-d28638e48f79')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f9ee567-31, col_values=(('external_ids', {'iface-id': '1f9ee567-317a-4ded-93be-9ff37424298f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:78:1a', 'vm-uuid': '8ffe39c0-2f69-4ab4-bcf0-548f93b231a7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:09 user nova-compute[74839]: INFO os_vif [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31')
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] No BDM found with device name hda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] No VIF found with MAC fa:16:3e:f1:e3:29, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] No VIF found with MAC fa:16:3e:58:99:1c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Using config drive
Nov 18 15:33:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Creating config drive at /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/disk.config
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp41xx_cyc {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp41xx_cyc" returned: 0 in 0.054s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIgNAwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== connect_volume: return (2603ms) {'type': 'block', 'scsi_wwn': '23138663466363836', 'path': '/dev/sdg'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138663466363836', 'path': '/dev/sdg'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e80441a-5c23-490f-8fe3-fde7ca91270a {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:33:10 user nova-compute[74839]:   <uuid>5e80441a-5c23-490f-8fe3-fde7ca91270a</uuid>
Nov 18 15:33:10 user nova-compute[74839]:   <name>instance-0000000a</name>
Nov 18 15:33:10 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:33:10 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:33:10 user nova-compute[74839]:   <metadata>
Nov 18 15:33:10 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:33:10 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:name>tempest-device-tagging-server-2040520718</nova:name>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:33:03</nova:creationTime>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:33:10 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:33:10 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:owner>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:user uuid="7bda38a528344edfacaea3420375bd2b">tempest-TaggedBootDevicesTest_v242-1681417481-project-member</nova:user>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:project uuid="42d52c8758e845d2843372cf46d8546f">tempest-TaggedBootDevicesTest_v242-1681417481</nova:project>
Nov 18 15:33:10 user nova-compute[74839]:       </nova:owner>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:33:10 user nova-compute[74839]:       <nova:ports>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="3a76d87f-373b-41bc-bbb7-e2c50dacd409">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="7378ff76-aa38-48cb-b2fa-9ff658b7b442">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="58f6b00a-0e4c-4994-9ef6-8c1f5800def3">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="159f3b98-181b-482b-9ad0-116dc5f76d13">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:         <nova:port uuid="88d03611-96cb-4927-851a-793c6b99935d">
Nov 18 15:33:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 18 15:33:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:33:10 user nova-compute[74839]:       </nova:ports>
Nov 18 15:33:10 user nova-compute[74839]:     </nova:instance>
Nov 18 15:33:10 user nova-compute[74839]:   </metadata>
Nov 18 15:33:10 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:33:10 user nova-compute[74839]:     <system>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="serial">5e80441a-5c23-490f-8fe3-fde7ca91270a</entry>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="uuid">5e80441a-5c23-490f-8fe3-fde7ca91270a</entry>
Nov 18 15:33:10 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:33:10 user nova-compute[74839]:     </system>
Nov 18 15:33:10 user nova-compute[74839]:   </sysinfo>
Nov 18 15:33:10 user nova-compute[74839]:   <os>
Nov 18 15:33:10 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:33:10 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:33:10 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:33:10 user nova-compute[74839]:   </os>
Nov 18 15:33:10 user nova-compute[74839]:   <features>
Nov 18 15:33:10 user nova-compute[74839]:     <acpi/>
Nov 18 15:33:10 user nova-compute[74839]:     <apic/>
Nov 18 15:33:10 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:33:10 user nova-compute[74839]:   </features>
Nov 18 15:33:10 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:33:10 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:33:10 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:33:10 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:33:10 user nova-compute[74839]:   </clock>
Nov 18 15:33:10 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:33:10 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:33:10 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:33:10 user nova-compute[74839]:   </cpu>
Nov 18 15:33:10 user nova-compute[74839]:   <devices>
Nov 18 15:33:10 user nova-compute[74839]:     <disk type="file" device="cdrom">
Nov 18 15:33:10 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 15:33:10 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/disk.config"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="hda" bus="ide"/>
Nov 18 15:33:10 user nova-compute[74839]:     </disk>
Nov 18 15:33:10 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:10 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:10 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <serial>2096dd89-b364-4dc2-b3ef-17073a061ff8</serial>
Nov 18 15:33:10 user nova-compute[74839]:     </disk>
Nov 18 15:33:10 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:10 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:10 user nova-compute[74839]:       <source dev="/dev/sde"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <serial>8db7a105-c54d-4b95-997c-58b5b33fd9a0</serial>
Nov 18 15:33:10 user nova-compute[74839]:     </disk>
Nov 18 15:33:10 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:33:10 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:10 user nova-compute[74839]:       <source dev="/dev/sdg"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="vdc" bus="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <serial>aa6240e7-e65e-40b8-b7a7-4396f256b5c2</serial>
Nov 18 15:33:10 user nova-compute[74839]:     </disk>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:55:1d:fc"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tapa4cd7ed2-ea"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:c1:5b:a6"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap3a76d87f-37"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:10:69:7c"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap7378ff76-aa"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:f2:5b:ef"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap6f6a2fc0-be"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:d6:4e:af"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap58f6b00a-0e"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:02:9c:15"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap159f3b98-18"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:33:10 user nova-compute[74839]:       <mac address="fa:16:3e:a9:4d:43"/>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:33:10 user nova-compute[74839]:       <target dev="tap88d03611-96"/>
Nov 18 15:33:10 user nova-compute[74839]:     </interface>
Nov 18 15:33:10 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:33:10 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/console.log" append="off"/>
Nov 18 15:33:10 user nova-compute[74839]:     </serial>
Nov 18 15:33:10 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:33:10 user nova-compute[74839]:     <video>
Nov 18 15:33:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:33:10 user nova-compute[74839]:     </video>
Nov 18 15:33:10 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:33:10 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:33:10 user nova-compute[74839]:     </rng>
Nov 18 15:33:10 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:33:10 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:33:10 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:33:10 user nova-compute[74839]:     </memballoon>
Nov 18 15:33:10 user nova-compute[74839]:   </devices>
Nov 18 15:33:10 user nova-compute[74839]: </domain>
Nov 18 15:33:10 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fce6ad65-0743-5c9c-b641-2b808bff1bf4', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4cd7ed2-ea, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4cd7ed2-ea, col_values=(('qos', UUID('293a4338-d877-4974-9896-f6349b5b9225')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4cd7ed2-ea, col_values=(('external_ids', {'iface-id': 'a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1d:fc', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea')
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1541d2d4-75f9-5f38-954e-f20008146432', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a76d87f-37, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a76d87f-37, col_values=(('qos', UUID('eb02e518-e790-4a39-8334-fff1bf10d993')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a76d87f-37, col_values=(('external_ids', {'iface-id': '3a76d87f-373b-41bc-bbb7-e2c50dacd409', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:5b:a6', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37')
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65e2e187-08df-5a1d-b283-36e4921de6df', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7378ff76-aa, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7378ff76-aa, col_values=(('qos', UUID('3b1f8ed4-6c94-4be3-83ea-bae12c8c9bfa')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7378ff76-aa, col_values=(('external_ids', {'iface-id': '7378ff76-aa38-48cb-b2fa-9ff658b7b442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:69:7c', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa')
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df828d9-86d4-53e9-9b06-a925ef6b0b9e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f6a2fc0-be, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f6a2fc0-be, col_values=(('qos', UUID('fda18684-3306-417b-b08a-04ad26c6957d')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f6a2fc0-be, col_values=(('external_ids', {'iface-id': '6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:5b:ef', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be')
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db7bc4b3-632b-596e-8677-59e2c4055953', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58f6b00a-0e, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58f6b00a-0e, col_values=(('qos', UUID('2b6f68de-dde4-4622-96b5-e37dc6c9c190')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58f6b00a-0e, col_values=(('external_ids', {'iface-id': '58f6b00a-0e4c-4994-9ef6-8c1f5800def3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:4e:af', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e')
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbeb6fda-cfcd-53fd-a147-7c9a640f452d', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap159f3b98-18, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap159f3b98-18, col_values=(('qos', UUID('a9e79d59-ba1c-4186-badb-8f86d20cd60c')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap159f3b98-18, col_values=(('external_ids', {'iface-id': '159f3b98-181b-482b-9ad0-116dc5f76d13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:9c:15', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:11 user nova-compute[74839]: WARNING nova.compute.manager [req-06b02826-7fea-4687-8545-378c5be9ccd8 req-49561405-b669-4664-bea3-12363145f2df service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 for instance with vm_state building and task_state spawning.
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18')
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63fd4a35-2d25-5be4-8598-7949767eeb3e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88d03611-96, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88d03611-96, col_values=(('qos', UUID('fa80449c-8b75-44eb-86aa-ba86e5af5534')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88d03611-96, col_values=(('external_ids', {'iface-id': '88d03611-96cb-4927-851a-793c6b99935d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:4d:43', 'vm-uuid': '5e80441a-5c23-490f-8fe3-fde7ca91270a'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:12 user nova-compute[74839]: WARNING nova.compute.manager [req-87b3f0d0-146d-4430-b13f-4688c96562bd req-90848c45-cd63-4c8a-9ae1-ac9d6747e16b service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 for instance with vm_state building and task_state spawning.
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: INFO os_vif [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96')
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] No BDM found with device name hda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] No VIF found with MAC fa:16:3e:55:1d:fc, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] No VIF found with MAC fa:16:3e:d6:4e:af, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Using config drive
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Creating config drive at /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/disk.config
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd7dgqs9p {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd7dgqs9p" returned: 0 in 0.052s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:12 user nova-compute[74839]: WARNING nova.compute.manager [req-2429a9f1-42f4-48cc-8f36-632ed95d02ab req-a09b66ad-9d4e-4e39-84dd-8f24211e2c14 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 for instance with vm_state building and task_state spawning.
Nov 18 15:33:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:13 user nova-compute[74839]: WARNING nova.compute.manager [req-c09a2ac1-7b75-4b1f-9bb9-916f5f9d1432 req-4ad1b6ee-ee7b-44f8-a09a-aae57d134f9a service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 for instance with vm_state building and task_state spawning.
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:14 user nova-compute[74839]: WARNING nova.compute.manager [req-68ccae7a-b9ef-419d-be86-732f7becb2f6 req-9e6eecc0-cd7b-454a-bee9-fc26b7af0ad0 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 for instance with vm_state building and task_state spawning.
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:14 user nova-compute[74839]: WARNING nova.compute.manager [req-996a64df-ab6d-4ae4-9563-7ba63f7c7796 req-dfa98cb4-4748-4f77-9a6f-dfd17d6e8f20 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 for instance with vm_state building and task_state spawning.
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:15 user nova-compute[74839]: WARNING nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f for instance with vm_state building and task_state spawning.
Nov 18 15:33:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:15 user nova-compute[74839]: WARNING nova.compute.manager [req-b6f5f1d0-b364-4a30-935d-736e4f44b3fb req-234e70cc-2fcd-49cb-b2ce-75209e88792e service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f for instance with vm_state building and task_state spawning.
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-3d1909c5-bd52-41b3-bbc1-6691f6f49350 req-3191c1fc-76dc-409f-a7f2-24f0b6be6710 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:33:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance spawned successfully.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 for instance with vm_state building and task_state spawning.
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:16 user nova-compute[74839]: WARNING nova.compute.manager [req-4f0cbbc7-dbb8-451c-b539-fe66b403220b req-f9c37417-ed19-4747-9c44-1fcc59191545 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 for instance with vm_state building and task_state spawning.
Nov 18 15:33:17 user nova-compute[74839]: INFO nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Took 14.54 seconds to spawn the instance on the hypervisor.
Nov 18 15:33:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: INFO nova.compute.manager [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Took 36.01 seconds to build instance.
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17818a1a-280d-45b9-a97e-9762d80fa4a7 tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.222s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:17 user nova-compute[74839]: WARNING nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 for instance with vm_state building and task_state spawning.
Nov 18 15:33:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:17 user nova-compute[74839]: WARNING nova.compute.manager [req-fc4da799-f1b1-41e2-9af7-57cc04f07603 req-80a7cb0a-2b40-4145-9009-833bc6d40e26 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 for instance with vm_state building and task_state spawning.
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:18 user nova-compute[74839]: WARNING nova.compute.manager [req-a342f19b-9d62-468d-a8bd-f72515e6e8b5 req-4458b3e8-7233-468a-9faf-7fcee14942a5 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 for instance with vm_state building and task_state spawning.
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:33:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance spawned successfully.
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:33:18 user nova-compute[74839]: INFO nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Took 15.87 seconds to spawn the instance on the hypervisor.
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:18 user nova-compute[74839]: WARNING nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d for instance with vm_state building and task_state spawning.
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:18 user nova-compute[74839]: WARNING nova.compute.manager [req-cf1ee220-f4cb-4e9c-bf53-af1e5d097e22 req-86177939-4aca-4101-8263-d904e85a7dc1 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d for instance with vm_state building and task_state spawning.
Nov 18 15:33:19 user nova-compute[74839]: INFO nova.compute.manager [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Took 34.98 seconds to build instance.
Nov 18 15:33:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-985cc52a-9411-4b88-918f-426a079f9e69 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.173s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:26 user nova-compute[74839]: DEBUG nova.compute.manager [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:33:26 user nova-compute[74839]: INFO nova.compute.manager [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] instance snapshotting
Nov 18 15:33:26 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Beginning live snapshot process
Nov 18 15:33:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.165s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611.delta 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611.delta 1073741824" returned: 0 in 0.047s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 15:33:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74839) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 18 15:33:27 user nova-compute[74839]: INFO nova.virt.libvirt.host [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] UEFI support detected
Nov 18 15:33:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:33:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:33:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 15:33:28 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:33:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611.delta /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611.delta /opt/stack/data/nova/instances/snapshots/tmpekbvn1kb/2a023bacd6ce4446a41dd13e57359611" returned: 0 in 0.660s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Snapshot extracted, beginning image upload
Nov 18 15:33:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Snapshot image upload complete
Nov 18 15:33:32 user nova-compute[74839]: INFO nova.compute.manager [None req-53697a6c-2003-417d-bc7d-d9fc14a80036 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Took 5.33 seconds to snapshot the instance on the hypervisor.
Nov 18 15:33:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG nova.objects.instance [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lazy-loading 'flavor' on Instance uuid 3e387d43-67cf-453c-bc42-b1b380d18dee {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.151s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:33 user nova-compute[74839]: INFO nova.compute.manager [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Attaching volume 8cb5f1a6-ddef-49ed-92c2-edb320b06a03 to /dev/vdb
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.utils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc3ec32-941e-49e3-98aa-d731b0e6fe70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4617c66b-c6aa-4f20-90a8-947a6640a6f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35d363-9e46-474f-b57b-7cef0d33446e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06384d35-2022-4952-9695-cb0d1f292557]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:33 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd26e865-2007-4fb7-885a-d93f104d145e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG os_brick.utils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updating existing volume attachment record: 7931b94a-3e38-492b-9e28-45ac2b25da49 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing instance network info cache due to event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:33 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:33:34 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updated VIF entry in instance network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:33:34 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8ef131f-24c6-4220-8a63-6d97c505ce99 req-03af72f0-fc88-4e1d-9ba1-4408ccfd8781 service nova] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updating instance_info_cache with network_info: [{"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-3e387d43-67cf-453c-bc42-b1b380d18dee" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:33:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.013s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:37 user nova-compute[74839]: INFO nova.compute.manager [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Shelving
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:38 user nova-compute[74839]: WARNING nova.compute.manager [req-ec09a799-2f51-494c-a0b2-2a57a1be1c1d req-18cb23d8-ac4e-42e9-aac8-71b7f9fe2fc2 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state active and task_state shelving.
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance destroyed successfully.
Nov 18 15:33:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Beginning cold snapshot process
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk /opt/stack/data/nova/instances/snapshots/tmp2ivrfuun/f58e2c7339d643c9913eb1babb88b328 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk /opt/stack/data/nova/instances/snapshots/tmp2ivrfuun/f58e2c7339d643c9913eb1babb88b328" returned: 0 in 0.702s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Snapshot extracted, beginning image upload
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPVrAImu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:39 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:39 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:39 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72337de-202c-4f9d-b191-cfb5abcdc5f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:39 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[05277d25-8262-4fcf-a2e6-d40ed754c2d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03] added
Nov 18 15:33:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cd372d-03f4-445d-bb35-06c21edc184c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa3a5c1-eb46-4c64-a299-cfeeed7849c5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:40 user nova-compute[74839]: WARNING nova.compute.manager [req-2d4d0f2c-b33a-44a4-b325-8ff84d0df1a4 req-5f7d4374-b620-4667-a06d-3f180ec5cdef service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state active and task_state shelving_image_uploading.
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPVrAImu {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:40 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7018MB free_disk=25.65335464477539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPVrAImu" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90be3c-c70d-48ab-bee1-1246ad0bcd14]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPVrAImu'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba5852f-ad0a-4e6e-b9c6-b146e3885d4d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5033597-aa1a-4bd5-a666-074c49774779]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 3e387d43-67cf-453c-bc42-b1b380d18dee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 21d73872-2b83-48b1-b465-9309a293ad81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 5e80441a-5c23-490f-8fe3-fde7ca91270a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5abfcc6-b1c8-4095-8414-086767d68a7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260]
Nov 18 15:33:40 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[126cc2d7-705b-42c8-931b-628a4c9f1178]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d56582-7f5e-4896-8823-27dc21c5eb6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)
Nov 18 15:33:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.761s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da393562-99fa-4ede-b4ff-17af696c758d]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPVrAImu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:33:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.803s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] <== connect_volume: return (1805ms) {'type': 'block', 'scsi_wwn': '23333336534376337', 'path': '/dev/sdh'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333336534376337', 'path': '/dev/sdh'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lazy-loading 'flavor' on Instance uuid 3e387d43-67cf-453c-bc42-b1b380d18dee {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:33:41 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:41 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:33:41 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:33:41 user nova-compute[74839]:   <serial>8cb5f1a6-ddef-49ed-92c2-edb320b06a03</serial>
Nov 18 15:33:41 user nova-compute[74839]: </disk>
Nov 18 15:33:41 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:33:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] No VIF found with MAC fa:16:3e:aa:4f:93, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-710a9d58-1b9d-4594-91de-6941d99d3bcd tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.012s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Snapshot image upload complete
Nov 18 15:33:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:33:42 user nova-compute[74839]: INFO nova.compute.manager [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Shelve offloading
Nov 18 15:33:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance destroyed successfully.
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:43 user nova-compute[74839]: INFO nova.compute.manager [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Terminating instance
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-changed-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Refreshing instance network info cache due to event network-changed-c306b011-a6ed-4eea-985f-1edac8cf46ee. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] Acquiring lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] Acquired lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Refreshing network info cache for port c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-unplugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] No waiting events found dispatching network-vif-unplugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-79a41697-0141-4298-bab3-b1768a6eb015 req-b5c4f40d-7e98-43b8-bf58-a4852ebceef4 service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-unplugged-ba011248-dfed-44f3-b61d-19fa011e8bce for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Instance destroyed successfully.
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lazy-loading 'resources' on Instance uuid 3e387d43-67cf-453c-bc42-b1b380d18dee {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1242488551',display_name='tempest-DeleteServersTestJSON-server-1242488551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1242488551',id=2,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfbc177b26e8480ca247735651037f07',ramdisk_id='',reservation_id='r-2zudjsz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-945016737',owner_user_name='tempest-DeleteServersTestJSON-945016737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:31:54Z,user_data=None,user_id='8ca99d385812433ab0d7b3fe70aa5695',uuid=3e387d43-67cf-453c-bc42-b1b380d18dee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converting VIF {"id": "ba011248-dfed-44f3-b61d-19fa011e8bce", "address": "fa:16:3e:aa:4f:93", "network": {"id": "b911b04b-0454-4b24-8410-9c940e06a8a2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-263042005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfbc177b26e8480ca247735651037f07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba011248-df", "ovs_interfaceid": "ba011248-dfed-44f3-b61d-19fa011e8bce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_vif [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba011248-df, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fa193c1-ed32-43ca-8674-9def659acbd0) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:44 user nova-compute[74839]: INFO os_vif [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:4f:93,bridge_name='br-int',has_traffic_filtering=True,id=ba011248-dfed-44f3-b61d-19fa011e8bce,network=Network(b911b04b-0454-4b24-8410-9c940e06a8a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba011248-df')
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPVrAImu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:44 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac45271e-011c-4ff4-8312-4f3ba8a6771a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:33:44 user nova-compute[74839]: No targets found.
Nov 18 15:33:44 user nova-compute[74839]: iSNS:
Nov 18 15:33:44 user nova-compute[74839]: No targets found.
Nov 18 15:33:44 user nova-compute[74839]: STATIC:
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:33:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:33:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:33:44 user nova-compute[74839]: FIRMWARE:
Nov 18 15:33:44 user nova-compute[74839]: No targets found.
Nov 18 15:33:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:33:44 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:33:44 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[956584a9-7366-45f2-be74-416f6bc6729c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e926dab-a836-4193-a546-2c923b235431]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 (non-flash)
Nov 18 15:33:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480466680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03'): ({'sdh'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Removing single pathed devices sdh {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca2f8a-5c90-4684-b12b-db3bfec21e13]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc31f7d-a3c3-4821-a08a-7ca15c1d4925]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Flushing IO for device /dev/sdh {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e7070-42ce-47a2-b9dc-eade68b80c21]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updated VIF entry in instance network info cache for port c306b011-a6ed-4eea-985f-1edac8cf46ee. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e90c25c-830d-4560-91b9-9d05f19dbd49]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e91a6154-3d83-4c56-868c-5173b7b1a96d req-80ed00f9-b130-4d34-90b4-3fba70efeecc service nova] Releasing lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[438d4b17-77c9-469b-b168-4391b1677a5f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94de022-520e-4686-a05d-0624e613c278]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260]
Nov 18 15:33:44 user nova-compute[74839]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb5f1a6-ddef-49ed-92c2-edb320b06a03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52851be1-831e-41f2-9aa1-034e6f4d3131]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] <== disconnect_volume: return (345ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:33:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Deleting instance files /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee_del
Nov 18 15:33:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Deletion of /opt/stack/data/nova/instances/3e387d43-67cf-453c-bc42-b1b380d18dee_del complete
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance destroyed successfully.
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.objects.instance [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'resources' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.compute.manager [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 18 15:33:45 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4yYZM8oolwsDs4eJztk8p2sQ0k4YOhUSFERwBo+fGrI5IIzDXx9u4GSboz1eZiv5F+oKNt5j4TNItG3hRprfPwCQd63vgOlTn69ZFk2uQpQp44zgZEeONz9kuC0ckSFw==',key_name='tempest-keypair-494084705',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:33:42.808030',shelved_host='user',shelved_image_id='4898227b-fd87-4219-80b8-700f16d9b56c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG os_vif [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap426cda54-c5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=487b29f4-1892-4f8c-a426-fcfd8d979ad6) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:33:45 user nova-compute[74839]: INFO os_vif [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5')
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Deleting instance files /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81_del
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Deletion of /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81_del complete
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Deleted allocations for instance 21d73872-2b83-48b1-b465-9309a293ad81
Nov 18 15:33:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.objects.instance [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'numa_topology' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.objects.base [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<21d73872-2b83-48b1-b465-9309a293ad81> lazy-loaded attributes: resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cad669c5-4f29-4a16-b74b-5ba449c92d56 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.920s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:45 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Took 0.57 seconds to deallocate network for instance.
Nov 18 15:33:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-dac5f18d-7f3b-4a02-8623-1dfc2ca72def req-62a828a7-52f0-4a54-bf63-1ed2fbb908cb service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-deleted-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] Acquiring lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] No waiting events found dispatching network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:33:46 user nova-compute[74839]: WARNING nova.compute.manager [req-dc17ad89-959c-4922-af27-694e580001c8 req-cee06bf1-a39e-4a5b-92f9-ae33a9a8df5e service nova] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Received unexpected event network-vif-plugged-ba011248-dfed-44f3-b61d-19fa011e8bce for instance with vm_state active and task_state deleting.
Nov 18 15:33:46 user nova-compute[74839]: INFO nova.compute.manager [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] [instance: 3e387d43-67cf-453c-bc42-b1b380d18dee] Took 0.73 seconds to detach 1 volumes for instance.
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'flavor' on Instance uuid 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:46 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Deleted allocations for instance 3e387d43-67cf-453c-bc42-b1b380d18dee
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd58fb1a-c032-468e-bc4b-f70f4b631963 tempest-DeleteServersTestJSON-945016737 tempest-DeleteServersTestJSON-945016737-project-member] Lock "3e387d43-67cf-453c-bc42-b1b380d18dee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:46 user nova-compute[74839]: INFO nova.compute.manager [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Attaching volume 30602080-f3d3-474c-beba-75f353f3d1d8 to /dev/vdb
Nov 18 15:33:46 user nova-compute[74839]: DEBUG os_brick.utils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c02fd-9f93-4878-9297-590a5856ce8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[321c3af6-84b6-4466-871a-3a0576d74839]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[603733f7-3569-451d-b54e-376ffd742f32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8074e2c3-98be-4ad7-941c-f065db20b4c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:47 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:33:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c404a4-f6cd-4d15-bad0-7a33fbac2cf4]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG os_brick.utils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:47 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating existing volume attachment record: 96a5f90a-8bed-4f24-89d3-ac56b2cf3d8c {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:33:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuBZHAMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:52 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:52 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:52 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5c5b1-33b8-49eb-bc8e-890a9671fdb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:52 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7a567-f164-4671-ac66-009b7f3de880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8] added
Nov 18 15:33:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a60d1a9-afff-4945-95db-6326fd195eb0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da65d8-287c-471e-9e86-7726accffb22]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuBZHAMj {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuBZHAMj" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84984aee-e70a-4ce7-9016-00f400dae544]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EuBZHAMj'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fa5c3-5a50-4648-8fc8-f7bc9f5def14]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a7fdac-319a-4dfc-9c39-f79447bb41e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:52 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf8b86-9ec2-48db-a6fd-cb12f3d83a59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260]
Nov 18 15:33:52 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260] successful.
Nov 18 15:33:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34b74c-bf80-4684-b03e-419557619776]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[57053cda-2fea-4b39-903c-3458b84e7408]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:33:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[374520d4-098b-4719-84b0-7af26d40e9ec]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-changed-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Refreshing instance network info cache due to event network-changed-68399f97-b18a-47c7-8146-12c90804cb6d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] Acquiring lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] Acquired lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Refreshing network info cache for port 68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lazy-loading 'flavor' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updated VIF entry in instance network info cache for port 68399f97-b18a-47c7-8146-12c90804cb6d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updating instance_info_cache with network_info: [{"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuBZHAMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26530383163373163', 'path': '/dev/sdh'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530383163373163', 'path': '/dev/sdh'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d95b07-57bf-4375-8d81-7b013e20eb41 req-f2ec5e60-23c8-429d-bf36-b7da13e9ee0e service nova] Releasing lock "refresh_cache-4519ea92-d2c5-4871-a69e-fa50a3fcf6de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'flavor' on Instance uuid 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:54 user nova-compute[74839]: INFO nova.compute.manager [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attaching volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b to /dev/vdb
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:33:54 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:54 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:33:54 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:33:54 user nova-compute[74839]:   <serial>30602080-f3d3-474c-beba-75f353f3d1d8</serial>
Nov 18 15:33:54 user nova-compute[74839]: </disk>
Nov 18 15:33:54 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.utils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a620c9-7333-4efe-8fe8-026b5fcb9c2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8413b8e-121b-4b76-a65f-51ca060884a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba4f00-2347-4ffb-ae6c-90b001c9d149]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[488ef76b-e2e9-4a0d-a6c4-7f8e5f3f1a25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:54 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72993c12-4c54-428b-aae6-80ccaf50e208]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG os_brick.utils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updating existing volume attachment record: abc05362-4088-4b13-953d-64a8c337514f {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No VIF found with MAC fa:16:3e:9b:c3:fb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:33:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b26975e-9340-498c-9f83-eb8eb72793d8 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.767s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:56 user nova-compute[74839]: INFO nova.compute.manager [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Detaching volume 30602080-f3d3-474c-beba-75f353f3d1d8
Nov 18 15:33:56 user nova-compute[74839]: INFO nova.virt.block_device [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Attempting to driver detach volume 30602080-f3d3-474c-beba-75f353f3d1d8 from mountpoint /dev/vdb
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Attempting to detach device vdb from instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:33:56 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:56 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:33:56 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:33:56 user nova-compute[74839]:   <serial>30602080-f3d3-474c-beba-75f353f3d1d8</serial>
Nov 18 15:33:56 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:33:56 user nova-compute[74839]: </disk>
Nov 18 15:33:56 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:33:56 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully detached device vdb from instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 from the persistent domain config.
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:33:56 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:33:56 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:33:56 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:33:56 user nova-compute[74839]:   <serial>30602080-f3d3-474c-beba-75f353f3d1d8</serial>
Nov 18 15:33:56 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:33:56 user nova-compute[74839]: </disk>
Nov 18 15:33:56 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-changed-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Refreshing instance network info cache due to event network-changed-57cb73b7-3769-484e-9ab8-24c8b8b26dcb. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] Acquiring lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] Acquired lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:33:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Refreshing network info cache for port 57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lazy-loading 'flavor' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updated VIF entry in instance network info cache for port 57cb73b7-3769-484e-9ab8-24c8b8b26dcb. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating instance_info_cache with network_info: [{"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b7741a8b-799f-4ca8-8bef-5cd9366c0ea7 req-ca568c06-9d5d-4d4a-83e6-6b58804e51ac service nova] Releasing lock "refresh_cache-25559075-a7fe-464c-a454-3c7cdd8c0f51" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:33:57 user nova-compute[74839]: INFO nova.compute.manager [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Attaching volume 48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 to /dev/vdb
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.utils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d4189-8ec5-4796-8abc-522b300a0eb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a03a03-0ba4-4663-948b-932e1b6a3c5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7adf6c2-c514-4037-a19e-72cfa27c4bc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[104343b5-06e1-4c46-b640-33af57175e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:33:57 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:33:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[638dc4be-b236-4863-b249-4f234b9961a2]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG os_brick.utils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:33:57 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating existing volume attachment record: c1b7d2b4-1c2d-469f-b140-ee70d4101732 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:33:59 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:59 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:33:59 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c482eb-ff64-4844-9187-008080aeb00d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:33:59 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315eddd-5bc8-47f8-9b9d-472b2dedfb8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b] added
Nov 18 15:33:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:33:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b29d7ab-209d-4690-954b-bb1cb48d67d3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37d6fb-ff85-46ee-a0e3-e660d4b2f146]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuwgeQdR {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuwgeQdR" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f26eb-d0f0-4ee5-8840-d2167c5d2ad6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuwgeQdR'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba5880f-dc40-4f8b-860a-cf9c1e6e2f1f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d698b-7a00-4de8-bff0-8b9223d7cd79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8640775-ca03-4225-ab40-bdc6a3fa5d61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]
Nov 18 15:34:00 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:00 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e9bb8-721f-4673-8a3b-6f16ca97d7ff]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[435f2d4f-e9e9-4acd-a7d5-0b74d3e6ecb9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:00 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[441880a9-85b3-4f84-90ff-74cc84c87f8a]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23231393463346534', 'path': '/dev/sdi'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393463346534', 'path': '/dev/sdi'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lazy-loading 'flavor' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:34:01 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:01 user nova-compute[74839]:   <source dev="/dev/sdi"/>
Nov 18 15:34:01 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:01 user nova-compute[74839]:   <serial>69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b</serial>
Nov 18 15:34:01 user nova-compute[74839]: </disk>
Nov 18 15:34:01 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] No VIF found with MAC fa:16:3e:5c:82:92, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8175db8-60ce-44ae-aabe-3bdbc4f5591c tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.816s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBJPNetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:03 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[240951f3-04a2-45d4-9835-6f7e97ffca76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:34:03 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690dab9-bef3-41b7-bd98-893dd7593aec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2] added
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c01308-80fc-43e5-acaa-45f6c8a68885]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc99e6f3-a8dc-4b85-adc2-9d7708882134]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBJPNetL {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBJPNetL" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3b4811-e266-4436-8e5d-4c48a8159cdd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uBJPNetL'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee2ffa2-07df-4e9d-a96a-d6e2300b09aa]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[27783b38-9d99-49d2-8017-ea3b2ba394f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4696f5-4c3a-45ae-8706-f8db96f92e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa5ed77-74f1-4608-bbd9-5ca1f1973397]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dabf8f-eb73-4a18-a8b8-d56ec711762e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68b1905-5032-476f-94e2-02962fb940fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260]
Nov 18 15:34:03 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b88d8-b1ea-4ab2-8294-d0f22df003f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0374fdfe-5be1-419c-b57b-0c1ed0b9da0a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:03 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1284d96-071d-4760-bf70-39dcd1f41c6a]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea02d5cf-02e1-4e3c-ada1-6d159137ed04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bfa61c-ad2d-4d71-93c4-e1ac6d1531f8]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBJPNetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:03 user nova-compute[74839]: INFO nova.compute.manager [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Swapping volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b for ca31a1ca-d6e9-4bae-9b85-60813ec980b1
Nov 18 15:34:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-changed-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing instance network info cache due to event network-changed-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:03 user nova-compute[74839]: DEBUG nova.network.neutron [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing network info cache for port fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:04 user nova-compute[74839]: INFO nova.compute.manager [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Terminating instance
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'flavor' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updated VIF entry in instance network info cache for port fc17681d-3b08-4bd1-9d73-53a7b9d3cda4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9919f4a7-f896-447d-91f3-ea5c45546f8f req-cf371520-f2f9-4b68-ad33-387df6fbcdff service nova] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'pci_requests' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.objects.base [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Object Instance<59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b> lazy-loaded attributes: flavor,pci_requests {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-unplugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] No waiting events found dispatching network-vif-unplugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-15df6314-143e-4897-a110-86aeca837d7c req-0b80cd75-1702-47c6-a004-1338e35cd2d8 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-unplugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23238373030643335', 'path': '/dev/sdj'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238373030643335', 'path': '/dev/sdj'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lazy-loading 'flavor' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.policy [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c2f377a54cb47a492e284d02a4781d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84720179af9a446fa15a13fedf97ddee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:34:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] attach device xml: <disk type="block" device="disk">
Nov 18 15:34:04 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:04 user nova-compute[74839]:   <source dev="/dev/sdj"/>
Nov 18 15:34:04 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:04 user nova-compute[74839]:   <serial>48b54120-a5cd-4d5f-a2e1-59282cd8e9d2</serial>
Nov 18 15:34:04 user nova-compute[74839]: </disk>
Nov 18 15:34:04 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Instance destroyed successfully.
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.objects.instance [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lazy-loading 'resources' on Instance uuid 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-312044643',display_name='tempest-VolumesActionsTest-instance-312044643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-312044643',id=7,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dd5ad095b224b42b5e496ed9611ee44',ramdisk_id='',reservation_id='r-d8rgjt5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-568408303',owner_user_name='tempest-VolumesActionsTest-568408303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:17Z,user_data=None,user_id='fe7d466f9dc44a25ace23c56a11982f7',uuid=11ed3ee3-04c6-416f-a4ef-13aa849d8a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converting VIF {"id": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "address": "fa:16:3e:91:3e:dc", "network": {"id": "0cab233c-260f-4965-af77-82b176c58746", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1474797630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dd5ad095b224b42b5e496ed9611ee44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2991664-67", "ovs_interfaceid": "f2991664-67e9-4da9-b5d6-9b2df66ede01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG os_vif [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2991664-67, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da43a625-aa11-407c-abe0-99d34d65387f) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:05 user nova-compute[74839]: INFO os_vif [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:dc,bridge_name='br-int',has_traffic_filtering=True,id=f2991664-67e9-4da9-b5d6-9b2df66ede01,network=Network(0cab233c-260f-4965-af77-82b176c58746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2991664-67')
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Deleting instance files /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e_del
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Deletion of /opt/stack/data/nova/instances/11ed3ee3-04c6-416f-a4ef-13aa849d8a9e_del complete
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] No VIF found with MAC fa:16:3e:b6:d1:40, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.compute.manager [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 18 15:34:05 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.neutron [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Successfully created port: ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6a4a570e-b355-430b-90bc-972b4d63c77f tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.025s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-83247a15-96ed-4d85-895f-2ffa5e681aab req-6aebdc37-7ec8-41f0-966e-4672c459af70 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-deleted-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.compute.manager [req-83247a15-96ed-4d85-895f-2ffa5e681aab req-6aebdc37-7ec8-41f0-966e-4672c459af70 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Neutron deleted interface f2991664-67e9-4da9-b5d6-9b2df66ede01; detaching it from the instance and deleting it from the info cache
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.network.neutron [req-83247a15-96ed-4d85-895f-2ffa5e681aab req-6aebdc37-7ec8-41f0-966e-4672c459af70 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:05 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Took 0.73 seconds to deallocate network for instance.
Nov 18 15:34:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-83247a15-96ed-4d85-895f-2ffa5e681aab req-6aebdc37-7ec8-41f0-966e-4672c459af70 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Detach interface failed, port_id=f2991664-67e9-4da9-b5d6-9b2df66ede01, reason: Instance 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Successfully updated port: ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] volume_snapshot_create: create_info: {'snapshot_id': 'b4d61b55-ba85-42fe-9e53-36fd1491cc4a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74839) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] snap xml: <domainsnapshot>
Nov 18 15:34:06 user nova-compute[74839]:   <disks>
Nov 18 15:34:06 user nova-compute[74839]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 18 15:34:06 user nova-compute[74839]:       <source file="/dev/new_file"/>
Nov 18 15:34:06 user nova-compute[74839]:     </disk>
Nov 18 15:34:06 user nova-compute[74839]:     <disk name="vda" snapshot="no"/>
Nov 18 15:34:06 user nova-compute[74839]:   </disks>
Nov 18 15:34:06 user nova-compute[74839]: </domainsnapshot>
Nov 18 15:34:06 user nova-compute[74839]:  {{(pid=74839) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] Lazy-loading 'system_metadata' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     rv = execute(f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     six.reraise(c, e, tb)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     raise value
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     rv = meth(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     self._volume_snapshot_create(context, instance, guest,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     rv = execute(f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     six.reraise(c, e, tb)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     raise value
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     rv = meth(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] 
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f26e0e29-7061-4c43-ae85-161f3bd489f1 tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] volume_snapshot_delete: delete_info: {'volume_id': '48b54120-a5cd-4d5f-a2e1-59282cd8e9d2'} {{(pid=74839) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [None req-f26e0e29-7061-4c43-ae85-161f3bd489f1 tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51]     if delete_info['type'] != 'qcow2':
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] KeyError: 'type'
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] 
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b4d61b55-ba85-42fe-9e53-36fd1491cc4a could not be found.
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise value
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b4d61b55-ba85-42fe-9e53-36fd1491cc4a could not be found. (HTTP 404) (Request-ID: req-ebed595f-8028-47de-a381-e9a1ad3c893b)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b4d61b55-ba85-42fe-9e53-36fd1491cc4a could not be found.
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Deleted allocations for instance 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver [None req-f26e0e29-7061-4c43-ae85-161f3bd489f1 tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-dfe86cc1-ac19-4160-86e6-f8ea898730fa)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 18 15:34:06 user nova-compute[74839]: ERROR nova.virt.libvirt.driver 
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server [None req-ef830dbc-aa61-4369-9d24-36763612d52b tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise value
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server 
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server [None req-f26e0e29-7061-4c43-ae85-161f3bd489f1 tempest-VolumesAssistedSnapshotsTest-965826360 tempest-VolumesAssistedSnapshotsTest-965826360-project] Exception during message handling: KeyError: 'type'
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 18 15:34:06 user nova-compute[74839]: ERROR oslo_messaging.rpc.server 
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9223aebd-99e8-4ad7-8284-9d8d6879a439 tempest-VolumesActionsTest-568408303 tempest-VolumesActionsTest-568408303-project-member] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] Acquiring lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] Lock "11ed3ee3-04c6-416f-a4ef-13aa849d8a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] No waiting events found dispatching network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:06 user nova-compute[74839]: WARNING nova.compute.manager [req-69848beb-62e3-4fc8-801a-6da41b762ca3 req-0172cc3d-e8b3-4292-8c17-dfedaeccde68 service nova] [instance: 11ed3ee3-04c6-416f-a4ef-13aa849d8a9e] Received unexpected event network-vif-plugged-f2991664-67e9-4da9-b5d6-9b2df66ede01 for instance with vm_state deleted and task_state None.
Nov 18 15:34:06 user nova-compute[74839]: INFO nova.compute.manager [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Detaching volume 48b54120-a5cd-4d5f-a2e1-59282cd8e9d2
Nov 18 15:34:06 user nova-compute[74839]: INFO nova.virt.block_device [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Attempting to driver detach volume 48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 from mountpoint /dev/vdb
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Attempting to detach device vdb from instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:06 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:06 user nova-compute[74839]:   <source dev="/dev/sdj"/>
Nov 18 15:34:06 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:06 user nova-compute[74839]:   <serial>48b54120-a5cd-4d5f-a2e1-59282cd8e9d2</serial>
Nov 18 15:34:06 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:34:06 user nova-compute[74839]: </disk>
Nov 18 15:34:06 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Successfully detached device vdb from instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 from the persistent domain config.
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:06 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:06 user nova-compute[74839]:   <source dev="/dev/sdj"/>
Nov 18 15:34:06 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:06 user nova-compute[74839]:   <serial>48b54120-a5cd-4d5f-a2e1-59282cd8e9d2</serial>
Nov 18 15:34:06 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:34:06 user nova-compute[74839]: </disk>
Nov 18 15:34:06 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG os_vif [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2a96cb6-adb1-52f2-8970-20c065460860', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec364259-ff, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec364259-ff, col_values=(('qos', UUID('caf0e066-0bbc-4e51-bbbd-bb31f8f3215c')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec364259-ff, col_values=(('external_ids', {'iface-id': 'ec364259-ff2b-41d2-80f3-9dfeb7824932', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:f9:d9', 'vm-uuid': '59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: INFO os_vif [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff')
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] attach device xml: <interface type="ethernet">
Nov 18 15:34:06 user nova-compute[74839]:   <mac address="fa:16:3e:33:f9:d9"/>
Nov 18 15:34:06 user nova-compute[74839]:   <model type="virtio"/>
Nov 18 15:34:06 user nova-compute[74839]:   <mtu size="1442"/>
Nov 18 15:34:06 user nova-compute[74839]:   <target dev="tapec364259-ff"/>
Nov 18 15:34:06 user nova-compute[74839]: </interface>
Nov 18 15:34:06 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name hda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No VIF found with MAC fa:16:3e:1d:12:ab, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:34:07 user nova-compute[74839]:   <nova:package version="0.0.0"/>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:name>tempest-device-tagging-server-178092732</nova:name>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:creationTime>2023-11-18 15:34:07</nova:creationTime>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:flavor name="m1.tiny">
Nov 18 15:34:07 user nova-compute[74839]:     <nova:memory>512</nova:memory>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:disk>1</nova:disk>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:swap>0</nova:swap>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:vcpus>1</nova:vcpus>
Nov 18 15:34:07 user nova-compute[74839]:   </nova:flavor>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:owner>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:user uuid="5c2f377a54cb47a492e284d02a4781d4">tempest-TaggedAttachmentsTest-2005585609-project-member</nova:user>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:project uuid="84720179af9a446fa15a13fedf97ddee">tempest-TaggedAttachmentsTest-2005585609</nova:project>
Nov 18 15:34:07 user nova-compute[74839]:   </nova:owner>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:34:07 user nova-compute[74839]:   <nova:ports>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:port uuid="fc17681d-3b08-4bd1-9d73-53a7b9d3cda4">
Nov 18 15:34:07 user nova-compute[74839]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:34:07 user nova-compute[74839]:     </nova:port>
Nov 18 15:34:07 user nova-compute[74839]:     <nova:port uuid="ec364259-ff2b-41d2-80f3-9dfeb7824932">
Nov 18 15:34:07 user nova-compute[74839]:       <nova:ip type="fixed" address="10.10.10.141" ipVersion="4"/>
Nov 18 15:34:07 user nova-compute[74839]:     </nova:port>
Nov 18 15:34:07 user nova-compute[74839]:   </nova:ports>
Nov 18 15:34:07 user nova-compute[74839]: </nova:instance>
Nov 18 15:34:07 user nova-compute[74839]:  {{(pid=74839) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 15:34:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74aa3a09-4ede-48a9-878b-fe1f373affd6 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.306s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-changed-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing instance network info cache due to event network-changed-ec364259-ff2b-41d2-80f3-9dfeb7824932. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Refreshing network info cache for port ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'flavor' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:08 user nova-compute[74839]: INFO nova.compute.manager [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Attaching volume 81847bb7-74cf-469c-960c-dec7e7d3ef92 to /dev/vdb
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.utils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b98cdb-f1e8-4e32-9797-ffde6d8d688f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[88accb65-b3f7-4f73-ab40-ab7f566efb5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3dd7bb-b46c-4fe0-9147-7d4701768160]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd514d-212b-4556-8b70-44502226f224]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:08 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:34:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad67bf-1473-41de-bba0-1fa85bd59d86]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG os_brick.utils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:08 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating existing volume attachment record: a98ba2e6-cb53-408e-b685-2c63200ef7e4 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.network.neutron [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updated VIF entry in instance network info cache for port ec364259-ff2b-41d2-80f3-9dfeb7824932. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.network.neutron [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:09 user nova-compute[74839]: WARNING nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 for instance with vm_state active and task_state None.
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:09 user nova-compute[74839]: WARNING nova.compute.manager [req-8dc1f346-b4ce-4c9d-9be8-84c3df8a1076 req-11fb9d0e-add5-43a6-9c47-e9e05d85e309 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 for instance with vm_state active and task_state None.
Nov 18 15:34:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'serial': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'serial'} {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:10 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:10 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:10 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56abcb37-545f-4fc3-9183-12f2d879597c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:34:10 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[50142ed5-1fda-41e8-aa13-306e68521026]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1] added
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a699be8f-70e7-4a46-9742-28a7a8383c39]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d3a90-498a-427f-a8ed-fb4e36f1ce41]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApOosyTL {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApOosyTL" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec90ae5-84fb-420c-b07c-260cc50250c8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApOosyTL'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002759b-f0f7-44bf-b772-ad7e7b30ad54]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f9d61f-29d6-4b20-b3fc-76afa5175c76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[725dbd63-4caa-4afd-ba4f-429861295ae7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260]
Nov 18 15:34:10 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eab7f8a-c895-4777-a141-e452439d3b02]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da8023-8b56-40a1-a390-83ab386f3212]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb8732-24bb-428e-978b-d1afc6087790]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23633633966323364', 'path': '/dev/sdk'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633633966323364', 'path': '/dev/sdk'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lazy-loading 'flavor' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 401604608 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 542113792 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNKqkJCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:15 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:15 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:15 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce80f05-7829-4175-b90a-c48e87615a6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:34:15 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265d986-2fee-43cf-9cad-2bd933d12b7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92] added
Nov 18 15:34:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[74348b42-5811-443a-abbd-cb67a0666026]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e0758b-b1a6-4f3c-a2c5-e7d1012eb377]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNKqkJCb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XNKqkJCb" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5bcb6e-f801-49b7-a660-d5b15b611952]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XNKqkJCb'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f342ca-420a-415c-895e-77f26f5bddc9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4633b9ff-9370-41ae-ac2d-029b14c83468]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa164e1b-678d-4fca-8826-bf5310b6feab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260]
Nov 18 15:34:15 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf6473-5d59-476a-8627-983a3238d5c6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cde645d-5278-4118-8895-71d3efc619bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb5ce8-9e97-4e4a-8a3c-1bf9807398a3]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNKqkJCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:16 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:16 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 is timed out.
Nov 18 15:34:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully detached device vdb from instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 from the live domain config.
Nov 18 15:34:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuBZHAMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:16 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23066303166346364', 'path': '/dev/sdl'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066303166346364', 'path': '/dev/sdl'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.623s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'flavor' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27dd49-dbf2-4be8-95b7-a630e1942aee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]: iSNS:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]: STATIC:
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:17 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:17 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:34:17 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:17 user nova-compute[74839]:   <source dev="/dev/sdl"/>
Nov 18 15:34:17 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:17 user nova-compute[74839]:   <serial>81847bb7-74cf-469c-960c-dec7e7d3ef92</serial>
Nov 18 15:34:17 user nova-compute[74839]: </disk>
Nov 18 15:34:17 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef80b75d-88de-4c8a-83be-074339e16da4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a705e-8039-4181-bc35-e5eaf467071d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48064c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b'): ({'sdi'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Removing single pathed devices sdi {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a8f80-855c-4c95-b408-8362c3dde31b]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f41aa50-25b5-4179-9e31-dd645c85a5b7]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Flushing IO for device /dev/sdi {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.011s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731d890-06a5-434f-a145-730e3baf81bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad65a3-15e6-4bce-9404-04f91367ae3b]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] SCSI volumes sdi have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[74757617-0761-4cb4-86de-50204b0c4db6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3162c06-6f79-478c-b67e-3e55cc79bf0c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]
Nov 18 15:34:17 user nova-compute[74839]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd8b16-4994-45f8-ba87-97b4f442f309]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== disconnect_volume: return (981ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.579s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f94cb-ce3b-4874-8e9a-bad998bf388f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]: iSNS:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]: STATIC:
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:17 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:17 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:17 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:17 user nova-compute[74839]: No targets found.
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:17 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:17 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e429a11-0641-4ec5-9662-699578b0550c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'serial'} {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: removing Cinder connection for volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16739081-d518-4dc7-9d29-a92fe5e23de9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 (non-flash)
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4805153f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8'): ({'sdh'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Removing single pathed devices sdh {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No BDM found with device name hda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] No VIF found with MAC fa:16:3e:1d:12:ab, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20d999-d3ba-4d32-931a-d0995a7bee6a]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86bb58c-4861-48f5-85a1-dde8dc66d01d]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Flushing IO for device /dev/sdh {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da92070-7ca5-409e-86c5-793f2995dd93]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2b25e-cd25-4ab9-87c1-c47f412245d5]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d48c7-c77a-474b-a9b9-a4965727135b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3efdf689-a82b-444d-bf56-782f62a99776 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.432s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e0b2c-0349-466e-8a37-02e866c7c7ac]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260]
Nov 18 15:34:17 user nova-compute[74839]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30602080-f3d3-474c-beba-75f353f3d1d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a96fe1-39f8-4926-acc8-28b1734e577a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] <== disconnect_volume: return (938ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: Updating volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ApOosyTL", "auth_password": "Akp8noItcBN06s", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "ca31a1ca-d6e9-4bae-9b85-60813ec980b1"}, "status": "reserved", "instance": "4519ea92-d2c5-4871-a69e-fa50a3fcf6de", "attached_at": "", "detached_at": "", "volume_id": "ca31a1ca-d6e9-4bae-9b85-60813ec980b1", "serial": "ca31a1ca-d6e9-4bae-9b85-60813ec980b1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'no_device': None, 'attachment_id': 'b788b779-a378-4dae-ae88-3ec668ac4abe'} {{(pid=74839) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0cec216f-5390-4eed-82cf-563d1c6200c2 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.829s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG nova.objects.instance [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'flavor' on Instance uuid 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7bb3966a-6944-4292-a5cd-8c5f2de02080 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.509s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:18 user nova-compute[74839]: DEBUG os_brick.utils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84e1b9-71f1-4810-8075-81f3baa1ce35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da3c1c-cd4e-4fad-9a0a-d32741bab2f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75cf5a3-2cce-4847-93fe-027dc2d8bd76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccc5db8-5a38-4a32-9e29-ce6843e076f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:19 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd412375-9226-424f-b978-3e43267d3161]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG os_brick.utils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:19 user nova-compute[74839]: INFO nova.compute.manager [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Detaching volume 81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:19 user nova-compute[74839]: INFO nova.compute.manager [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Swapping volume ca31a1ca-d6e9-4bae-9b85-60813ec980b1 for 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:19 user nova-compute[74839]: INFO nova.virt.block_device [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Attempting to driver detach volume 81847bb7-74cf-469c-960c-dec7e7d3ef92 from mountpoint /dev/vdb
Nov 18 15:34:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Attempting to detach device vdb from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:19 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:19 user nova-compute[74839]:   <source dev="/dev/sdl"/>
Nov 18 15:34:19 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:19 user nova-compute[74839]:   <serial>81847bb7-74cf-469c-960c-dec7e7d3ef92</serial>
Nov 18 15:34:19 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 15:34:19 user nova-compute[74839]: </disk>
Nov 18 15:34:19 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:19 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully detached device vdb from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the persistent domain config.
Nov 18 15:34:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:19 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:19 user nova-compute[74839]:   <source dev="/dev/sdl"/>
Nov 18 15:34:19 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:19 user nova-compute[74839]:   <serial>81847bb7-74cf-469c-960c-dec7e7d3ef92</serial>
Nov 18 15:34:19 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 15:34:19 user nova-compute[74839]: </disk>
Nov 18 15:34:19 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:34:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'serial': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1'}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'serial'} {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:24 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:24 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:24 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2272e0d1-88c0-4fe8-856b-3c0c81726f46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:34:24 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0ee0b-0acf-4d6b-95db-82c3d24b9fae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b] added
Nov 18 15:34:24 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb2169f-0a4d-4d34-bb4e-226d569f0f6d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9050e47e-c79b-44e1-be27-f89c1cff7a9a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuwgeQdR {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuwgeQdR" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc9eff4-48f2-41f1-9fc9-3742b132e057]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuwgeQdR'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38e10b-5040-45d3-bed3-49e71ed176ca]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac80f63-22ef-4b50-a903-c27566d85a12]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[64430307-3015-4305-b5dd-d9c9c0e1a261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]
Nov 18 15:34:25 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51ba6f-713a-4280-8ae4-81f3771efff7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d20569c-d283-4d75-b790-1cf92ae4fd36]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:25 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7072c-dc46-4e10-983c-592957a026a4]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23231393463346534', 'path': '/dev/sdh'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393463346534', 'path': '/dev/sdh'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lazy-loading 'flavor' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 68157440 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:27 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 is timed out.
Nov 18 15:34:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Successfully detached device vdb from instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 from the live domain config.
Nov 18 15:34:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBJPNetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:27 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd31fe7-54d8-486b-8e47-2600dcb3015e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:27 user nova-compute[74839]: No targets found.
Nov 18 15:34:27 user nova-compute[74839]: iSNS:
Nov 18 15:34:27 user nova-compute[74839]: No targets found.
Nov 18 15:34:27 user nova-compute[74839]: STATIC:
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:27 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:27 user nova-compute[74839]: No targets found.
Nov 18 15:34:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:27 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:27 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78f0d3-6b1e-4735-b0ba-2b536cfabb5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e865228c-0af6-4ff8-a307-f3aedbf96043]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:27 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd498178820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2'): ({'sdj'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Removing single pathed devices sdj {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9104ffa7-6713-4fb3-87fe-293bad4e11d3]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0f579-e53c-4a42-b6ee-4672e404d7e1]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Flushing IO for device /dev/sdj {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4721eac1-76cc-4946-9a50-fed267fc5720]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.071s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da647a-474b-4627-97bd-16ea704e899b]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] SCSI volumes sdj have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9716bb-debf-407e-ae6f-2806b8b73b86]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 255852544 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f72f72-6cac-49bc-b4ab-0afcac1239e6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260]
Nov 18 15:34:27 user nova-compute[74839]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b54120-a5cd-4d5f-a2e1-59282cd8e9d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa007aea-9d8f-4dc7-974b-9a823a72c0bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] <== disconnect_volume: return (473ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 413138944 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 586153984 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lazy-loading 'flavor' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1dc23cf8-d11c-4f29-8279-9e1d44c67185 tempest-VolumesAssistedSnapshotsTest-43954655 tempest-VolumesAssistedSnapshotsTest-43954655-project-admin] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.346s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApOosyTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'ca31a1ca-d6e9-4bae-9b85-60813ec980b1'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:30 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[459f254f-74c0-465c-96ae-39848776df51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:30 user nova-compute[74839]: No targets found.
Nov 18 15:34:30 user nova-compute[74839]: iSNS:
Nov 18 15:34:30 user nova-compute[74839]: No targets found.
Nov 18 15:34:30 user nova-compute[74839]: STATIC:
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:30 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:30 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:30 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:30 user nova-compute[74839]: No targets found.
Nov 18 15:34:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:30 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:30 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b80b0-44c3-4025-a7f7-00299694ad8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb4548-43a2-4fd3-ac5b-7055a4a6ffae]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:30 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48013f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1'): ({'sdk'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Removing single pathed devices sdk {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1620f8-db3e-4b01-95f4-c58ba383d591]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf486a-1a7a-47ce-8dd1-50321c3b09cf]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Flushing IO for device /dev/sdk {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.011s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f2392-44c6-4f4d-a2b7-e14f7a6e962f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e53d10-928b-402c-9c15-a1fe385e1379]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] SCSI volumes sdk have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a7fd59-328a-4c93-9dbf-67b9f97eac48]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e568dcf-547d-4e92-b0d9-a2eeb8143d3e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260]
Nov 18 15:34:30 user nova-compute[74839]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca31a1ca-d6e9-4bae-9b85-60813ec980b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f370d4-a1b7-45cc-a370-1ce7f0712c35]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] <== disconnect_volume: return (301ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '4519ea92-d2c5-4871-a69e-fa50a3fcf6de', 'attached_at': '', 'detached_at': '', 'volume_id': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'serial'} {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 18 15:34:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: removing Cinder connection for volume ca31a1ca-d6e9-4bae-9b85-60813ec980b1 {{(pid=74839) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] swap_volume: Updating volume ca31a1ca-d6e9-4bae-9b85-60813ec980b1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "tuwgeQdR", "auth_password": "UchEPJyDzZWK4C", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b"}, "status": "reserved", "instance": "4519ea92-d2c5-4871-a69e-fa50a3fcf6de", "attached_at": "", "detached_at": "", "volume_id": "69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b", "serial": "69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'no_device': None, 'attachment_id': '48f36ed5-5bab-4fa6-9fcd-d40ce54cf30a'} {{(pid=74839) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1d640b19-0725-4453-b257-54b6935e5616 tempest-TestVolumeSwap-951047941 tempest-TestVolumeSwap-951047941-project-admin] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.444s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-changed-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing instance network info cache due to event network-changed-1c117963-6a73-43d6-9664-2b5afab2f3e6. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] Acquiring lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] Acquired lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Refreshing network info cache for port 1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:32 user nova-compute[74839]: INFO nova.compute.manager [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Detaching volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updated VIF entry in instance network info cache for port 1c117963-6a73-43d6-9664-2b5afab2f3e6. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d733ddd4-6b3c-4aa1-b812-4a3feac620bd req-8ff933e0-ee8a-4780-b526-f96a96f527db service nova] Releasing lock "refresh_cache-8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:32 user nova-compute[74839]: INFO nova.virt.block_device [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Attempting to driver detach volume 69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b from mountpoint /dev/vdb
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Attempting to detach device vdb from instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:32 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:34:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:32 user nova-compute[74839]:   <serial>69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b</serial>
Nov 18 15:34:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:34:32 user nova-compute[74839]: </disk>
Nov 18 15:34:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Successfully detached device vdb from instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de from the persistent domain config.
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:34:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:32 user nova-compute[74839]:   <source dev="/dev/sdh"/>
Nov 18 15:34:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:34:32 user nova-compute[74839]:   <serial>69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b</serial>
Nov 18 15:34:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:34:32 user nova-compute[74839]: </disk>
Nov 18 15:34:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:34 user nova-compute[74839]: INFO nova.compute.manager [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Terminating instance
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:34:34 user nova-compute[74839]: INFO nova.compute.claims [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Claim successful on node user
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-d2f78da0-243b-40ce-afb6-31b858c72947 req-f7265314-48b8-476d-b5b5-b4b077a0300f service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-4a6fa12a-aba0-4c91-aa11-7b65d0c36137 req-dfc2ee42-374c-4861-8ba4-8ad80fc22f75 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-92afd869-82b3-4ea7-b180-5202a9d42935 req-fd8f754a-1c29-4b7f-8dd4-6fa7bcef2720 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:35 user nova-compute[74839]: INFO nova.virt.block_device [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Booting with blank volume at /dev/vda
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.policy [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b86e5899c041e88609206af0613940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0b5e1598374e26b3b0c081e6ca38d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Instance destroyed successfully.
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lazy-loading 'resources' on Instance uuid 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Successfully created port: c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c117963-6a, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eae372a-fe44-4ea4-83aa-a06d3b69b1ec) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=1c117963-6a73-43d6-9664-2b5afab2f3e6,network=Network(f49ef785-d1d3-4e27-99f3-0b390dd9cbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c117963-6a')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1771be62-4c, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02dd5118-ca83-452a-82a2-10dad0ea851e) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=1771be62-4c19-4faa-aaf9-060fd0cc4d6c,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1771be62-4c')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76f43e4e-63, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f652696-a0f0-4c7c-baa1-06ad82fecc0d) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:60:f9,bridge_name='br-int',has_traffic_filtering=True,id=76f43e4e-63ba-4d7c-baba-2d432f08c163,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap76f43e4e-63')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee14998-ea, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b227936-d910-4a4a-99ea-8127c8176669) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:56,bridge_name='br-int',has_traffic_filtering=True,id=7ee14998-eac8-4462-90a5-97eb5c541f74,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee14998-ea')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "address": "fa:16:3e:58:99:1c", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf23cd7a1-c7", "ovs_interfaceid": "f23cd7a1-c7a6-4973-ac87-48bd723eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf23cd7a1-c7, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8a20994-30a9-474c-81b6-3b5ce3ca145a) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:1c,bridge_name='br-int',has_traffic_filtering=True,id=f23cd7a1-c7a6-4973-ac87-48bd723eee21,network=Network(1f8e6d15-0022-4de2-9f0e-e18262dd1207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf23cd7a1-c7')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3df99199-a2, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2eec9af0-2b92-4eff-828c-f286ce839bdd) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:9d:4b,bridge_name='br-int',has_traffic_filtering=True,id=3df99199-a24f-40f4-8fad-31b223c6a1b1,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3df99199-a2')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2023976883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2023976883',id=9,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQu5ZmYaXvwtsn9z4sWTBLam8Z8vR9Kx2rboUUHBDF3q2OiE8k2MtDaV1KrseN0f0Y9DNaCYnvqid1cE7lI4S8xy7h6IcdKbPXrgwn8u3iCrJyjCQP8d9tJP9e3Bgaj0Q==',key_name='tempest-keypair-1724765324',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d158b075964d93aac7e73c22af57f6',ramdisk_id='',reservation_id='r-0r3lsm4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-813747827',owner_user_name='tempest-TaggedBootDevicesTest-813747827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12be125ca9d848a3ad3a5ff48749ebcb',uuid=8ffe39c0-2f69-4ab4-bcf0-548f93b231a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converting VIF {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f9ee567-31, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8862520-aaec-4a32-9f0f-d28638e48f79) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:36 user nova-compute[74839]: INFO os_vif [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:78:1a,bridge_name='br-int',has_traffic_filtering=True,id=1f9ee567-317a-4ded-93be-9ff37424298f,network=Network(82ca3d56-34c4-4d79-b5f0-b12575a15a41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f9ee567-31')
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQPnetBV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:36 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a9216-8b4c-42ed-b56b-bae7083dc04f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]: iSNS:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]: STATIC:
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:36 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:36 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Successfully updated port: c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9d8a6-01ba-4384-852e-ac4d0a4df26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: WARNING nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1c117963-6a73-43d6-9664-2b5afab2f3e6 for instance with vm_state active and task_state deleting.
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: WARNING nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1771be62-4c19-4faa-aaf9-060fd0cc4d6c for instance with vm_state active and task_state deleting.
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-7ee14998-eac8-4462-90a5-97eb5c541f74 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: WARNING nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-7ee14998-eac8-4462-90a5-97eb5c541f74 for instance with vm_state active and task_state deleting.
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-6548c577-3423-4a73-8742-847bd31eded7 req-37494820-c35c-489c-924d-83636f7b10fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba0409-d03b-461f-bb2a-903d22cd2d57]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480194af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4db7d-600f-45ce-ab4f-406c3cb08fe2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[883ea797-ee65-49e0-b8a6-082d8383500d]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e6166-b255-4b4e-83f3-2c9ae2456b24]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66085b3-7589-4018-b188-3e9da0dc2ea0]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2646f6-4d3a-41e2-a40c-0813ffc81b9d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5116fcb-ffdd-4bc0-ad76-d6c912124e64]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260]
Nov 18 15:34:36 user nova-compute[74839]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3997f816-5517-44aa-a81c-dfe68faddadc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b652f1-8a94-4225-ad60-6e9ad069aa68]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== disconnect_volume: return (373ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHuDcIiR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:36 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e2dae-ce85-444e-be8e-8f45968cc9f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]: iSNS:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]: STATIC:
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:36 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:36 user nova-compute[74839]: No targets found.
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:36 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:36 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a92a50-bbf1-4d93-bd64-e8f9c2915f43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e01b6-1a08-4b77-a9b8-4efad8df904e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad (non-flash)
Nov 18 15:34:36 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480194af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad'): ({'sdf'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Removing single pathed devices sdf {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance network_info: |[{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:34:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c902df09-206b-4bb7-aaa4-874393031d5e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-changed-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing instance network info cache due to event network-changed-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Acquiring lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Acquired lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Refreshing network info cache for port a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d468a51-a19e-41a1-b9b4-1278447f615d]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:37 user nova-compute[74839]: WARNING nova.compute.manager [req-ad31f4f3-fd37-4618-b029-579a9fbc8ae9 req-408e32ed-49ef-4e4a-b1cd-6982c5b3b885 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-f23cd7a1-c7a6-4973-ac87-48bd723eee21 for instance with vm_state active and task_state deleting.
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Flushing IO for device /dev/sdf {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de15bce-d464-44af-b59c-0fa2354d0a58]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e2cc2-d88b-4a20-a770-813209b242be]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] SCSI volumes sdf have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3e7d1-9fdb-41ed-b151-61ab35457207]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1cf572-98e1-47e3-91b2-e0e01422bb4e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260]
Nov 18 15:34:37 user nova-compute[74839]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a690a23e-e83d-4b05-bd7d-116a0086c7ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e2220-f052-4648-8911-dde5aa465fc1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== disconnect_volume: return (364ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keWwIAxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:37 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ccad0-b78c-4b85-af79-7010b906f473]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:37 user nova-compute[74839]: No targets found.
Nov 18 15:34:37 user nova-compute[74839]: iSNS:
Nov 18 15:34:37 user nova-compute[74839]: No targets found.
Nov 18 15:34:37 user nova-compute[74839]: STATIC:
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:37 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:37 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:37 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:37 user nova-compute[74839]: No targets found.
Nov 18 15:34:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:37 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:37 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b054f493-5c17-49cd-a904-1c0fdab1f137]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a5058-c7b6-4884-809d-5c829bcb2a9b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48064c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c5194-4053-4de8-8d17-1a711198bc08]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f22b0-cb66-4dd5-972b-cb27310e4ba4]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec98f33-8c28-4343-ae41-182ff3d528f2]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a218c017-ba05-422e-b44c-7a942ef9b373]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e7802-5dda-47e0-a071-9f379c164ae5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updated VIF entry in instance network info cache for port a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [{"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac103171-9cb5-43d1-b264-4c9bf4f606d9]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260]
Nov 18 15:34:37 user nova-compute[74839]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Releasing lock "refresh_cache-5e80441a-5c23-490f-8fe3-fde7ca91270a" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:37 user nova-compute[74839]: WARNING nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-76f43e4e-63ba-4d7c-baba-2d432f08c163 for instance with vm_state active and task_state deleting.
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-changed-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Refreshing instance network info cache due to event network-changed-c05a6d87-de9e-4d8a-929c-024bdcdb85b9. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Refreshing network info cache for port c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2c2a31c-23f9-4372-8356-f741e21cfa2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e72e01-4850-4199-b655-90410b22311c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] <== disconnect_volume: return (367ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Deleting instance files /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7_del
Nov 18 15:34:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Deletion of /opt/stack/data/nova/instances/8ffe39c0-2f69-4ab4-bcf0-548f93b231a7_del complete
Nov 18 15:34:37 user nova-compute[74839]: INFO nova.compute.manager [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Took 3.58 seconds to destroy the instance on the hypervisor.
Nov 18 15:34:37 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:34:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updated VIF entry in instance network info cache for port c05a6d87-de9e-4d8a-929c-024bdcdb85b9. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53dd017d-b694-425c-bfd6-4eae75cd4aaf req-003fea48-904f-4109-b8ff-7b1bbcc17d64 service nova] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:38 user nova-compute[74839]: WARNING nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-3df99199-a24f-40f4-8fad-31b223c6a1b1 for instance with vm_state active and task_state deleting.
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-unplugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-unplugged-1f9ee567-317a-4ded-93be-9ff37424298f for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Acquiring lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] No waiting events found dispatching network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:38 user nova-compute[74839]: WARNING nova.compute.manager [req-e3305867-33aa-4a75-a47f-f24b22e79e16 req-4a93e0ef-a5f8-42e7-b94a-8d1a7551ed46 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received unexpected event network-vif-plugged-1f9ee567-317a-4ded-93be-9ff37424298f for instance with vm_state active and task_state deleting.
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:38 user nova-compute[74839]: INFO nova.compute.manager [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Terminating instance
Nov 18 15:34:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:34:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-d02730d2-946a-435b-aaf1-eb16146fc50c req-75e47d1e-792a-454d-a8d4-2d97670744d9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b is timed out.
Nov 18 15:34:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully detached device vdb from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the live domain config.
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XNKqkJCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:39 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81dc5b4-7036-45df-8ea6-317ce92bd8c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:39 user nova-compute[74839]: No targets found.
Nov 18 15:34:39 user nova-compute[74839]: iSNS:
Nov 18 15:34:39 user nova-compute[74839]: No targets found.
Nov 18 15:34:39 user nova-compute[74839]: STATIC:
Nov 18 15:34:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92
Nov 18 15:34:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:39 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:39 user nova-compute[74839]: No targets found.
Nov 18 15:34:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:39 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:39 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a3587-4c81-43d1-8486-e54db2f48f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.215s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22468bb-b2cd-4663-8e9d-e4bf95dcf556]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49829e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92'): ({'sdl'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Removing single pathed devices sdl {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02079ee-e5e4-4e0e-8ddc-5237f40e3f48]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d4437-e31c-42af-8de4-9cfb397f8abc]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Flushing IO for device /dev/sdl {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20807ce7-1cd7-4e42-a4a9-95ccddff4603]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.068s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a102ccd-8e5d-4a22-aab6-f00de2bab449]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] SCSI volumes sdl have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc1592-5d99-458b-aab9-e8281d30508a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-ff219758-7374-4add-8eaa-913baf4e060c req-0a947f7f-3f86-4007-ba9c-eb56cb3908e8 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-159f3b98-181b-482b-9ad0-116dc5f76d13 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31a4d5-471d-4272-8335-383915d474ec]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260]
Nov 18 15:34:40 user nova-compute[74839]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:40 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81847bb7-74cf-469c-960c-dec7e7d3ef92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a7d8cc-61fc-4c8e-bfd2-041e5c2933a0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.610s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] <== disconnect_volume: return (611ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:40 user nova-compute[74839]: WARNING nova.compute.manager [req-eddb14fc-d076-4596-a2db-6d056cee2c98 req-e20cafbb-57c5-4802-81c7-0ff70fb3e849 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 for instance with vm_state active and task_state deleting.
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 18 15:34:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Instance destroyed successfully.
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lazy-loading 'resources' on Instance uuid 5e80441a-5c23-490f-8fe3-fde7ca91270a {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "address": "fa:16:3e:55:1d:fc", "network": {"id": "d8df2dd4-88ba-4e1e-8858-9235c624752f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1139955178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4cd7ed2-ea", "ovs_interfaceid": "a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4cd7ed2-ea, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e162ec-3ceb-4dfc-8170-3d4ed716c4ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea65fee-c7c5-4bcd-9676-6da0ccf4f767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29ed58-8c00-40f0-92d7-49c44441f2af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408886e-a293-49f3-94dc-4f5214857f29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'flavor' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=293a4338-d877-4974-9896-f6349b5b9225) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:34:41 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56484446-d5fb-4f61-8b7d-701d8cce861d]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating existing volume attachment record: 88aa12ab-56d1-4c13-99e3-6d3b9bcf9535 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1427b149-ff3e-4feb-be70-cab9d361f25c tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.321s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1d:fc,bridge_name='br-int',has_traffic_filtering=True,id=a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b,network=Network(d8df2dd4-88ba-4e1e-8858-9235c624752f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4cd7ed2-ea')
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "address": "fa:16:3e:c1:5b:a6", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a76d87f-37", "ovs_interfaceid": "3a76d87f-373b-41bc-bbb7-e2c50dacd409", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a76d87f-37, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb02e518-e790-4a39-8334-fff1bf10d993) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5b:a6,bridge_name='br-int',has_traffic_filtering=True,id=3a76d87f-373b-41bc-bbb7-e2c50dacd409,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a76d87f-37')
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "address": "fa:16:3e:10:69:7c", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7378ff76-aa", "ovs_interfaceid": "7378ff76-aa38-48cb-b2fa-9ff658b7b442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7378ff76-aa, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b1f8ed4-6c94-4be3-83ea-bae12c8c9bfa) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:41 user nova-compute[74839]: WARNING nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b for instance with vm_state active and task_state deleting.
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-deleted-f23cd7a1-c7a6-4973-ac87-48bd723eee21 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: INFO nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Neutron deleted interface f23cd7a1-c7a6-4973-ac87-48bd723eee21; detaching it from the instance and deleting it from the info cache
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "address": "fa:16:3e:9a:9d:4b", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3df99199-a2", "ovs_interfaceid": "3df99199-a24f-40f4-8fad-31b223c6a1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-ec364259-ff2b-41d2-80f3-9dfeb7824932" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-ec364259-ff2b-41d2-80f3-9dfeb7824932" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Detach interface failed, port_id=f23cd7a1-c7a6-4973-ac87-48bd723eee21, reason: Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:41 user nova-compute[74839]: WARNING nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-3a76d87f-373b-41bc-bbb7-e2c50dacd409 for instance with vm_state active and task_state deleting.
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-deleted-3df99199-a24f-40f4-8fad-31b223c6a1b1 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: INFO nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Neutron deleted interface 3df99199-a24f-40f4-8fad-31b223c6a1b1; detaching it from the instance and deleting it from the info cache
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "address": "fa:16:3e:f1:e3:29", "network": {"id": "f49ef785-d1d3-4e27-99f3-0b390dd9cbe3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1474820784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c117963-6a", "ovs_interfaceid": "1c117963-6a73-43d6-9664-2b5afab2f3e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:41 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:69:7c,bridge_name='br-int',has_traffic_filtering=True,id=7378ff76-aa38-48cb-b2fa-9ff658b7b442,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7378ff76-aa')
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "address": "fa:16:3e:f2:5b:ef", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6a2fc0-be", "ovs_interfaceid": "6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f6a2fc0-be, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'flavor' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Detach interface failed, port_id=3df99199-a24f-40f4-8fad-31b223c6a1b1, reason: Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3b3a0842-2ea7-4995-aa9f-15b41b971346 req-bf7795a9-a4c0-44db-bfb4-2262e676b4fc service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fda18684-3306-417b-b08a-04ad26c6957d) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface> {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface> {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Attempting to detach device tapec364259-ff from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] detach device xml: <interface type="ethernet">
Nov 18 15:34:41 user nova-compute[74839]:   <mac address="fa:16:3e:33:f9:d9"/>
Nov 18 15:34:41 user nova-compute[74839]:   <model type="virtio"/>
Nov 18 15:34:41 user nova-compute[74839]:   <mtu size="1442"/>
Nov 18 15:34:41 user nova-compute[74839]:   <target dev="tapec364259-ff"/>
Nov 18 15:34:41 user nova-compute[74839]: </interface>
Nov 18 15:34:41 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface> {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 18 15:34:41 user nova-compute[74839]:   <name>instance-00000008</name>
Nov 18 15:34:41 user nova-compute[74839]:   <uuid>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</uuid>
Nov 18 15:34:41 user nova-compute[74839]:   <metadata>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:34:41 user nova-compute[74839]:   <nova:package version="0.0.0"/>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:name>tempest-device-tagging-server-178092732</nova:name>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:creationTime>2023-11-18 15:34:07</nova:creationTime>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:flavor name="m1.tiny">
Nov 18 15:34:41 user nova-compute[74839]:     <nova:memory>512</nova:memory>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:disk>1</nova:disk>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:swap>0</nova:swap>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:vcpus>1</nova:vcpus>
Nov 18 15:34:41 user nova-compute[74839]:   </nova:flavor>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:owner>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:user uuid="5c2f377a54cb47a492e284d02a4781d4">tempest-TaggedAttachmentsTest-2005585609-project-member</nova:user>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:project uuid="84720179af9a446fa15a13fedf97ddee">tempest-TaggedAttachmentsTest-2005585609</nova:project>
Nov 18 15:34:41 user nova-compute[74839]:   </nova:owner>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:34:41 user nova-compute[74839]:   <nova:ports>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:port uuid="fc17681d-3b08-4bd1-9d73-53a7b9d3cda4">
Nov 18 15:34:41 user nova-compute[74839]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:34:41 user nova-compute[74839]:     </nova:port>
Nov 18 15:34:41 user nova-compute[74839]:     <nova:port uuid="ec364259-ff2b-41d2-80f3-9dfeb7824932">
Nov 18 15:34:41 user nova-compute[74839]:       <nova:ip type="fixed" address="10.10.10.141" ipVersion="4"/>
Nov 18 15:34:41 user nova-compute[74839]:     </nova:port>
Nov 18 15:34:41 user nova-compute[74839]:   </nova:ports>
Nov 18 15:34:41 user nova-compute[74839]: </nova:instance>
Nov 18 15:34:41 user nova-compute[74839]:   </metadata>
Nov 18 15:34:41 user nova-compute[74839]:   <memory unit='KiB'>524288</memory>
Nov 18 15:34:41 user nova-compute[74839]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 15:34:41 user nova-compute[74839]:   <vcpu placement='static'>1</vcpu>
Nov 18 15:34:41 user nova-compute[74839]:   <resource>
Nov 18 15:34:41 user nova-compute[74839]:     <partition>/machine</partition>
Nov 18 15:34:41 user nova-compute[74839]:   </resource>
Nov 18 15:34:41 user nova-compute[74839]:   <sysinfo type='smbios'>
Nov 18 15:34:41 user nova-compute[74839]:     <system>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='version'>0.0.0</entry>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='serial'>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='uuid'>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:34:41 user nova-compute[74839]:       <entry name='family'>Virtual Machine</entry>
Nov 18 15:34:41 user nova-compute[74839]:     </system>
Nov 18 15:34:41 user nova-compute[74839]:   </sysinfo>
Nov 18 15:34:41 user nova-compute[74839]:   <os>
Nov 18 15:34:41 user nova-compute[74839]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 15:34:41 user nova-compute[74839]:     <boot dev='hd'/>
Nov 18 15:34:41 user nova-compute[74839]:     <smbios mode='sysinfo'/>
Nov 18 15:34:41 user nova-compute[74839]:   </os>
Nov 18 15:34:41 user nova-compute[74839]:   <features>
Nov 18 15:34:41 user nova-compute[74839]:     <acpi/>
Nov 18 15:34:41 user nova-compute[74839]:     <apic/>
Nov 18 15:34:41 user nova-compute[74839]:     <vmcoreinfo state='on'/>
Nov 18 15:34:41 user nova-compute[74839]:   </features>
Nov 18 15:34:41 user nova-compute[74839]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 15:34:41 user nova-compute[74839]:     <model fallback='forbid'>Nehalem</model>
Nov 18 15:34:41 user nova-compute[74839]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 15:34:41 user nova-compute[74839]:     <feature policy='require' name='vme'/>
Nov 18 15:34:41 user nova-compute[74839]:     <feature policy='require' name='x2apic'/>
Nov 18 15:34:41 user nova-compute[74839]:     <feature policy='require' name='hypervisor'/>
Nov 18 15:34:41 user nova-compute[74839]:   </cpu>
Nov 18 15:34:41 user nova-compute[74839]:   <clock offset='utc'>
Nov 18 15:34:41 user nova-compute[74839]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 15:34:41 user nova-compute[74839]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 15:34:41 user nova-compute[74839]:     <timer name='hpet' present='no'/>
Nov 18 15:34:41 user nova-compute[74839]:   </clock>
Nov 18 15:34:41 user nova-compute[74839]:   <on_poweroff>destroy</on_poweroff>
Nov 18 15:34:41 user nova-compute[74839]:   <on_reboot>restart</on_reboot>
Nov 18 15:34:41 user nova-compute[74839]:   <on_crash>destroy</on_crash>
Nov 18 15:34:41 user nova-compute[74839]:   <devices>
Nov 18 15:34:41 user nova-compute[74839]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 15:34:41 user nova-compute[74839]:     <disk type='file' device='disk'>
Nov 18 15:34:41 user nova-compute[74839]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 15:34:41 user nova-compute[74839]:       <source file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk' index='2'/>
Nov 18 15:34:41 user nova-compute[74839]:       <backingStore type='file' index='3'>
Nov 18 15:34:41 user nova-compute[74839]:         <format type='raw'/>
Nov 18 15:34:41 user nova-compute[74839]:         <source file='/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9'/>
Nov 18 15:34:41 user nova-compute[74839]:         <backingStore/>
Nov 18 15:34:41 user nova-compute[74839]:       </backingStore>
Nov 18 15:34:41 user nova-compute[74839]:       <target dev='vda' bus='virtio'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='virtio-disk0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </disk>
Nov 18 15:34:41 user nova-compute[74839]:     <disk type='file' device='cdrom'>
Nov 18 15:34:41 user nova-compute[74839]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 15:34:41 user nova-compute[74839]:       <source file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config' index='1'/>
Nov 18 15:34:41 user nova-compute[74839]:       <backingStore/>
Nov 18 15:34:41 user nova-compute[74839]:       <target dev='hda' bus='ide'/>
Nov 18 15:34:41 user nova-compute[74839]:       <readonly/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='ide0-0-0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </disk>
Nov 18 15:34:41 user nova-compute[74839]:     <controller type='usb' index='0' model='none'>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='usb'/>
Nov 18 15:34:41 user nova-compute[74839]:     </controller>
Nov 18 15:34:41 user nova-compute[74839]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='pci.0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </controller>
Nov 18 15:34:41 user nova-compute[74839]:     <controller type='ide' index='0'>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='ide'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 15:34:41 user nova-compute[74839]:     </controller>
Nov 18 15:34:41 user nova-compute[74839]:     <interface type='ethernet'>
Nov 18 15:34:41 user nova-compute[74839]:       <mac address='fa:16:3e:1d:12:ab'/>
Nov 18 15:34:41 user nova-compute[74839]:       <target dev='tapfc17681d-3b'/>
Nov 18 15:34:41 user nova-compute[74839]:       <model type='virtio'/>
Nov 18 15:34:41 user nova-compute[74839]:       <mtu size='1442'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='net0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </interface>
Nov 18 15:34:41 user nova-compute[74839]:     <interface type='ethernet'>
Nov 18 15:34:41 user nova-compute[74839]:       <mac address='fa:16:3e:33:f9:d9'/>
Nov 18 15:34:41 user nova-compute[74839]:       <target dev='tapec364259-ff'/>
Nov 18 15:34:41 user nova-compute[74839]:       <model type='virtio'/>
Nov 18 15:34:41 user nova-compute[74839]:       <mtu size='1442'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='net1'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </interface>
Nov 18 15:34:41 user nova-compute[74839]:     <serial type='pty'>
Nov 18 15:34:41 user nova-compute[74839]:       <source path='/dev/pts/7'/>
Nov 18 15:34:41 user nova-compute[74839]:       <log file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log' append='off'/>
Nov 18 15:34:41 user nova-compute[74839]:       <target type='isa-serial' port='0'>
Nov 18 15:34:41 user nova-compute[74839]:         <model name='isa-serial'/>
Nov 18 15:34:41 user nova-compute[74839]:       </target>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='serial0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </serial>
Nov 18 15:34:41 user nova-compute[74839]:     <console type='pty' tty='/dev/pts/7'>
Nov 18 15:34:41 user nova-compute[74839]:       <source path='/dev/pts/7'/>
Nov 18 15:34:41 user nova-compute[74839]:       <log file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log' append='off'/>
Nov 18 15:34:41 user nova-compute[74839]:       <target type='serial' port='0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='serial0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </console>
Nov 18 15:34:41 user nova-compute[74839]:     <input type='mouse' bus='ps2'>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='input0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </input>
Nov 18 15:34:41 user nova-compute[74839]:     <input type='keyboard' bus='ps2'>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='input1'/>
Nov 18 15:34:41 user nova-compute[74839]:     </input>
Nov 18 15:34:41 user nova-compute[74839]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 18 15:34:41 user nova-compute[74839]:       <listen type='address' address='0.0.0.0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </graphics>
Nov 18 15:34:41 user nova-compute[74839]:     <audio id='1' type='none'/>
Nov 18 15:34:41 user nova-compute[74839]:     <video>
Nov 18 15:34:41 user nova-compute[74839]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='video0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </video>
Nov 18 15:34:41 user nova-compute[74839]:     <memballoon model='virtio'>
Nov 18 15:34:41 user nova-compute[74839]:       <stats period='10'/>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='balloon0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </memballoon>
Nov 18 15:34:41 user nova-compute[74839]:     <rng model='virtio'>
Nov 18 15:34:41 user nova-compute[74839]:       <backend model='random'>/dev/urandom</backend>
Nov 18 15:34:41 user nova-compute[74839]:       <alias name='rng0'/>
Nov 18 15:34:41 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 15:34:41 user nova-compute[74839]:     </rng>
Nov 18 15:34:41 user nova-compute[74839]:   </devices>
Nov 18 15:34:41 user nova-compute[74839]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 15:34:41 user nova-compute[74839]:     <label>libvirt-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</label>
Nov 18 15:34:41 user nova-compute[74839]:     <imagelabel>libvirt-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</imagelabel>
Nov 18 15:34:41 user nova-compute[74839]:   </seclabel>
Nov 18 15:34:41 user nova-compute[74839]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 15:34:41 user nova-compute[74839]:     <label>+64055:+108</label>
Nov 18 15:34:41 user nova-compute[74839]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 15:34:41 user nova-compute[74839]:   </seclabel>
Nov 18 15:34:41 user nova-compute[74839]: </domain>
Nov 18 15:34:41 user nova-compute[74839]:  {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 15:34:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully detached device tapec364259-ff from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the persistent domain config.
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] (1/8): Attempting to detach device tapec364259-ff with device alias net1 from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] detach device xml: <interface type="ethernet">
Nov 18 15:34:41 user nova-compute[74839]:   <mac address="fa:16:3e:33:f9:d9"/>
Nov 18 15:34:41 user nova-compute[74839]:   <model type="virtio"/>
Nov 18 15:34:41 user nova-compute[74839]:   <mtu size="1442"/>
Nov 18 15:34:41 user nova-compute[74839]:   <target dev="tapec364259-ff"/>
Nov 18 15:34:41 user nova-compute[74839]: </interface>
Nov 18 15:34:41 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6a2fc0-be')
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "address": "fa:16:3e:d6:4e:af", "network": {"id": "a211c87c-7bee-4961-8212-a10636b293d3", "bridge": "br-int", "label": "tempest-device-tagging-net1-156544832", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f6b00a-0e", "ovs_interfaceid": "58f6b00a-0e4c-4994-9ef6-8c1f5800def3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58f6b00a-0e, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b6f68de-dde4-4622-96b5-e37dc6c9c190) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=58f6b00a-0e4c-4994-9ef6-8c1f5800def3,network=Network(a211c87c-7bee-4961-8212-a10636b293d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f6b00a-0e')
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "159f3b98-181b-482b-9ad0-116dc5f76d13", "address": "fa:16:3e:02:9c:15", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap159f3b98-18", "ovs_interfaceid": "159f3b98-181b-482b-9ad0-116dc5f76d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap159f3b98-18, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9e79d59-ba1c-4186-badb-8f86d20cd60c) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:9c:15,bridge_name='br-int',has_traffic_filtering=True,id=159f3b98-181b-482b-9ad0-116dc5f76d13,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap159f3b98-18')
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2040520718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2040520718',id=10,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrARL12TPzGrWXzTlE9/Tg58YjwIKN/UsKOtVwBPUdNmSvhuR4bma4TilpqIWPAqGokj43RKgYDxQxIzHPCLfe9AULUW/C0gvmrE3uEDAyxJp7uxjJT8nREm16HCacHgw==',key_name='tempest-keypair-1613340469',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42d52c8758e845d2843372cf46d8546f',ramdisk_id='',reservation_id='r-0jic02eb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1681417481',owner_user_name='tempest-TaggedBootDevicesTest_v242-1681417481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bda38a528344edfacaea3420375bd2b',uuid=5e80441a-5c23-490f-8fe3-fde7ca91270a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converting VIF {"id": "88d03611-96cb-4927-851a-793c6b99935d", "address": "fa:16:3e:a9:4d:43", "network": {"id": "a56baf39-62f8-42d3-a258-c3852406c282", "bridge": "br-int", "label": "tempest-device-tagging-net2-1051129189", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "42d52c8758e845d2843372cf46d8546f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d03611-96", "ovs_interfaceid": "88d03611-96cb-4927-851a-793c6b99935d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88d03611-96, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa80449c-8b75-44eb-86aa-ba86e5af5534) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: INFO os_vif [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:4d:43,bridge_name='br-int',has_traffic_filtering=True,id=88d03611-96cb-4927-851a-793c6b99935d,network=Network(a56baf39-62f8-42d3-a258-c3852406c282),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d03611-96')
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kLvzDmxO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e23a04-1901-457c-a4d3-488e908a0b01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: iSNS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: STATIC:
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:42 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee2934-cd3b-4d13-b228-2e06f9de51ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a860a-338f-4e70-9f82-cf08b850324b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48073be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b3e2b-79aa-4b55-b10e-de850f7b31ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0e689-5c31-4608-aa11-3b10cbd8e309]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cfaf36-2aec-4b4e-94cb-b295f12859ff]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[710150a0-035b-4f42-af13-52d50488b404]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26531613962653065', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d501108', '/dev/disk/by-id/scsi-1SCST_BIO4d501108-e1a9be0e2dc7ee37') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26531613962653065
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4d501108
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4d501108-e1a9be0e2dc7ee37
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737c2ca-859b-446f-bf8e-c5a6ae5156b4]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Start waiting for the detach event from libvirt for device tapec364259-ff with device alias net1 for instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[372b13c1-8ec6-408d-94a8-dec43e77c529]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-159f3b98-181b-482b-9ad0-116dc5f76d13 for instance with vm_state active and task_state deleting.
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-88d03611-96cb-4927-851a-793c6b99935d for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING nova.compute.manager [req-4dd20893-c37c-437f-9143-c7dfe411834d req-35922178-2920-41c4-82d8-52713ea12df9 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-88d03611-96cb-4927-851a-793c6b99935d for instance with vm_state active and task_state deleting.
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [{"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a1918-7e0b-4b03-8dff-5875f08fcb81]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260]
Nov 18 15:34:42 user nova-compute[74839]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-2a9f7c8c-3c7a-4325-9738-badd6962d3a6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2096dd89-b364-4dc2-b3ef-17073a061ff8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c87dc-70ea-4e05-b55a-b9040c0d10f1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== disconnect_volume: return (369ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nANLIZjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba59347-26fd-45fe-9285-68f2b1f46576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: iSNS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: STATIC:
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:42 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8260b7-25e9-475f-bd43-657f87eb02ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39af9b-e6d1-4a70-86d9-4928a775ed6e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480516440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d8f3d-d8ce-4476-9fcf-e9988f74f01a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1642bc6-4c17-45b5-a244-048c3f55d870]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd33530-77de-433e-ae55-4ee59ea60de7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4225eb-42f0-47d7-b7d9-f4257b8851ec]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114e584-b6f7-4e43-a7fc-7adbabc4b0f4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba56f8-1f7d-41eb-8643-1d5116da9c6e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260]
Nov 18 15:34:42 user nova-compute[74839]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8db7a105-c54d-4b95-997c-58b5b33fd9a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7724251-b432-4511-b44c-f71516d46a0c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== disconnect_volume: return (316ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIgNAwJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:42 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7024204f-5c06-497a-82f5-90e3408f8ccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: iSNS:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]: STATIC:
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:42 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:42 user nova-compute[74839]: No targets found.
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:42 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:42 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b73802-8f8f-4d26-9fae-2c8ca393c425]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2688b52b-416b-49a2-97bc-95eed432430a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:42 user nova-compute[74839]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 (non-flash)
Nov 18 15:34:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480739510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2'): ({'sdg'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Removing single pathed devices sdg {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d8991-39a4-4765-b06e-a713d3bd7eab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01283dce-5609-49c3-b94c-8ec7c77c1e2f]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Flushing IO for device /dev/sdg {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e2c9a-a68d-4067-b6b6-3d53cd1ba9cd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0900af8-6410-4eee-88de-bb01278e7fc1]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] SCSI volumes sdg have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ccbcac-4334-4938-be5e-b769b70fb3f1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c0c35f-feb9-4da3-8698-0328fc1b2620]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260]
Nov 18 15:34:43 user nova-compute[74839]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa6240e7-e65e-40b8-b7a7-4396f256b5c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f08c37-a179-4cdb-b741-ee990e65af83]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] <== disconnect_volume: return (356ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Deleting instance files /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a_del
Nov 18 15:34:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Deletion of /opt/stack/data/nova/instances/5e80441a-5c23-490f-8fe3-fde7ca91270a_del complete
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: INFO nova.compute.manager [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Took 4.32 seconds to destroy the instance on the hypervisor.
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:43 user nova-compute[74839]: WARNING nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-7378ff76-aa38-48cb-b2fa-9ff658b7b442 for instance with vm_state active and task_state deleting.
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-unplugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-unplugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-deleted-1c117963-6a73-43d6-9664-2b5afab2f3e6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: INFO nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Neutron deleted interface 1c117963-6a73-43d6-9664-2b5afab2f3e6; detaching it from the instance and deleting it from the info cache
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f9ee567-317a-4ded-93be-9ff37424298f", "address": "fa:16:3e:7d:78:1a", "network": {"id": "82ca3d56-34c4-4d79-b5f0-b12575a15a41", "bridge": "br-int", "label": "tempest-device-tagging-net2-2058294796", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f9ee567-31", "ovs_interfaceid": "1f9ee567-317a-4ded-93be-9ff37424298f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Detach interface failed, port_id=1c117963-6a73-43d6-9664-2b5afab2f3e6, reason: Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Acquiring lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] No waiting events found dispatching network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:43 user nova-compute[74839]: WARNING nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received unexpected event network-vif-plugged-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 for instance with vm_state active and task_state deleting.
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-unplugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-unplugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:43 user nova-compute[74839]: WARNING nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-unplugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 for instance with vm_state active and task_state None.
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-deleted-1f9ee567-317a-4ded-93be-9ff37424298f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:43 user nova-compute[74839]: INFO nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Neutron deleted interface 1f9ee567-317a-4ded-93be-9ff37424298f; detaching it from the instance and deleting it from the info cache
Nov 18 15:34:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [{"id": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "address": "fa:16:3e:b0:7c:e2", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1771be62-4c", "ovs_interfaceid": "1771be62-4c19-4faa-aaf9-060fd0cc4d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "address": "fa:16:3e:7e:60:f9", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f43e4e-63", "ovs_interfaceid": "76f43e4e-63ba-4d7c-baba-2d432f08c163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ee14998-eac8-4462-90a5-97eb5c541f74", "address": "fa:16:3e:44:93:56", "network": {"id": "1f8e6d15-0022-4de2-9f0e-e18262dd1207", "bridge": "br-int", "label": "tempest-device-tagging-net1-187113474", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "56d158b075964d93aac7e73c22af57f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee14998-ea", "ovs_interfaceid": "7ee14998-eac8-4462-90a5-97eb5c541f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Detach interface failed, port_id=1f9ee567-317a-4ded-93be-9ff37424298f, reason: Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:44 user nova-compute[74839]: WARNING nova.compute.manager [req-c882b787-3e63-472d-803e-aedce5931e5b req-eed995bb-cf37-4570-a6fb-0ddfa2a159a4 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-ec364259-ff2b-41d2-80f3-9dfeb7824932 for instance with vm_state active and task_state None.
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:44 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Took 6.82 seconds to deallocate network for instance.
Nov 18 15:34:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:44 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '5e80441a-5c23-490f-8fe3-fde7ca91270a' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '5e80441a-5c23-490f-8fe3-fde7ca91270a' (instance-0000000a)
Nov 18 15:34:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8236MB free_disk=25.658672332763672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 5e80441a-5c23-490f-8fe3-fde7ca91270a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-6573eb05-ea86-47af-ab53-5d65eb75a643 req-8f38d5af-e157-4eed-b2d7-69c8c1ae538d service nova] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Received event network-vif-deleted-7ee14998-eac8-4462-90a5-97eb5c541f74 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:47 user nova-compute[74839]: INFO nova.compute.manager [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] [instance: 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7] Took 2.73 seconds to detach 3 volumes for instance.
Nov 18 15:34:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:47 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Deleted allocations for instance 8ffe39c0-2f69-4ab4-bcf0-548f93b231a7
Nov 18 15:34:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0dfbfc56-bd89-4504-b859-68cb2970082b tempest-TaggedBootDevicesTest-813747827 tempest-TaggedBootDevicesTest-813747827-project-member] Lock "8ffe39c0-2f69-4ab4-bcf0-548f93b231a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.617s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:47 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:47 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Took 4.55 seconds to deallocate network for instance.
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-2be6921e-a363-476d-a547-37aad509243b req-31ec3c71-4c7c-4a43-8ca0-e1ef79ac563c service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-deleted-159f3b98-181b-482b-9ad0-116dc5f76d13 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-2be6921e-a363-476d-a547-37aad509243b req-31ec3c71-4c7c-4a43-8ca0-e1ef79ac563c service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-deleted-58f6b00a-0e4c-4994-9ef6-8c1f5800def3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-2be6921e-a363-476d-a547-37aad509243b req-31ec3c71-4c7c-4a43-8ca0-e1ef79ac563c service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-deleted-88d03611-96cb-4927-851a-793c6b99935d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-2be6921e-a363-476d-a547-37aad509243b req-31ec3c71-4c7c-4a43-8ca0-e1ef79ac563c service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-deleted-6f6a2fc0-bebc-46b3-b865-18ed4d5c03a5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-2be6921e-a363-476d-a547-37aad509243b req-31ec3c71-4c7c-4a43-8ca0-e1ef79ac563c service nova] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Received event network-vif-deleted-a4cd7ed2-ea31-42f9-9f29-4bdf1d6b0a3b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:34:48 user nova-compute[74839]: INFO nova.compute.claims [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Claim successful on node user
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:34:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Creating image(s)
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start _get_guest_xml network_info=[{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '88aa12ab-56d1-4c13-99e3-6d3b9bcf9535', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8', 'attached_at': '', 'detached_at': '', 'volume_id': '99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'serial': '99a8f7cc-e2f9-482a-9bf1-39aceceb4215'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:34:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:48 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b85fa7-eccc-4216-a39a-a4e7b074aa53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:34:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[96578fc2-2451-431d-8056-226e439de7df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215] added
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23e79d-ae7f-4c93-9bda-81c2c262deb1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a97e14-3d33-479d-9b55-af29ef1b8d03]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QauMSdgH {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QauMSdgH" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82387d1-33b9-4804-86e4-949764c20604]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QauMSdgH'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0906a85-8e27-425b-8ff0-090e4f70e6eb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8df07-3a80-4187-bf30-32fcff7da5a5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef04345-3d7a-496e-8c5f-1a4eab81e983]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260]
Nov 18 15:34:48 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1f945-e57a-4097-8eed-8b49fb908462]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24fd1de-097c-40a0-b0f6-53b2eaa2d45e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:48 user nova-compute[74839]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:48 user nova-compute[74839]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:34:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6103d3-d212-445b-9387-983d38bb8c82]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:34:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.policy [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '162cc08b925a423caa2f868e93dffdee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e132ce68d4ff9bfd9e25e9e0dd141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:34:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Creating image(s)
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "/opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "/opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "/opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk 1073741824" returned: 0 in 0.057s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23836383163356265', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836383163356265', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591171237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591171237',id=11,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-edk04wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:35Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:34:49 user nova-compute[74839]:   <uuid>2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</uuid>
Nov 18 15:34:49 user nova-compute[74839]:   <name>instance-0000000b</name>
Nov 18 15:34:49 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:34:49 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:34:49 user nova-compute[74839]:   <metadata>
Nov 18 15:34:49 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:34:49 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1591171237</nova:name>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:34:48</nova:creationTime>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:34:49 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:34:49 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:owner>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:34:49 user nova-compute[74839]:       </nova:owner>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:34:49 user nova-compute[74839]:       <nova:ports>
Nov 18 15:34:49 user nova-compute[74839]:         <nova:port uuid="c05a6d87-de9e-4d8a-929c-024bdcdb85b9">
Nov 18 15:34:49 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 15:34:49 user nova-compute[74839]:         </nova:port>
Nov 18 15:34:49 user nova-compute[74839]:       </nova:ports>
Nov 18 15:34:49 user nova-compute[74839]:     </nova:instance>
Nov 18 15:34:49 user nova-compute[74839]:   </metadata>
Nov 18 15:34:49 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:34:49 user nova-compute[74839]:     <system>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="serial">2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</entry>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="uuid">2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</entry>
Nov 18 15:34:49 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:34:49 user nova-compute[74839]:     </system>
Nov 18 15:34:49 user nova-compute[74839]:   </sysinfo>
Nov 18 15:34:49 user nova-compute[74839]:   <os>
Nov 18 15:34:49 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:34:49 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:34:49 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:34:49 user nova-compute[74839]:   </os>
Nov 18 15:34:49 user nova-compute[74839]:   <features>
Nov 18 15:34:49 user nova-compute[74839]:     <acpi/>
Nov 18 15:34:49 user nova-compute[74839]:     <apic/>
Nov 18 15:34:49 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:34:49 user nova-compute[74839]:   </features>
Nov 18 15:34:49 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:34:49 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:34:49 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:34:49 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:34:49 user nova-compute[74839]:   </clock>
Nov 18 15:34:49 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:34:49 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:34:49 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:34:49 user nova-compute[74839]:   </cpu>
Nov 18 15:34:49 user nova-compute[74839]:   <devices>
Nov 18 15:34:49 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:34:49 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:34:49 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:34:49 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:34:49 user nova-compute[74839]:       <serial>99a8f7cc-e2f9-482a-9bf1-39aceceb4215</serial>
Nov 18 15:34:49 user nova-compute[74839]:     </disk>
Nov 18 15:34:49 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:34:49 user nova-compute[74839]:       <mac address="fa:16:3e:a1:fa:14"/>
Nov 18 15:34:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:49 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:34:49 user nova-compute[74839]:       <target dev="tapc05a6d87-de"/>
Nov 18 15:34:49 user nova-compute[74839]:     </interface>
Nov 18 15:34:49 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:34:49 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/console.log" append="off"/>
Nov 18 15:34:49 user nova-compute[74839]:     </serial>
Nov 18 15:34:49 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:34:49 user nova-compute[74839]:     <video>
Nov 18 15:34:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:49 user nova-compute[74839]:     </video>
Nov 18 15:34:49 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:34:49 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:34:49 user nova-compute[74839]:     </rng>
Nov 18 15:34:49 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:34:49 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:34:49 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:34:49 user nova-compute[74839]:     </memballoon>
Nov 18 15:34:49 user nova-compute[74839]:   </devices>
Nov 18 15:34:49 user nova-compute[74839]: </domain>
Nov 18 15:34:49 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591171237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591171237',id=11,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-edk04wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:35Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG os_vif [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dba7467-07c8-5256-a49b-e716c0088345', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Cannot resize image /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Ensure instance console log exists: /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc05a6d87-de, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc05a6d87-de, col_values=(('qos', UUID('84e59ffe-34f7-4ca9-bf5f-572aedd21890')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc05a6d87-de, col_values=(('external_ids', {'iface-id': 'c05a6d87-de9e-4d8a-929c-024bdcdb85b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:fa:14', 'vm-uuid': '2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: INFO os_vif [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de')
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:a1:fa:14, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Successfully created port: 9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:34:50 user nova-compute[74839]: INFO nova.compute.manager [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] [instance: 5e80441a-5c23-490f-8fe3-fde7ca91270a] Took 2.62 seconds to detach 3 volumes for instance.
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Successfully updated port: 9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquired lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-changed-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Refreshing instance network info cache due to event network-changed-9df8a201-048c-4813-a497-60505dd5b01b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] Acquiring lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:50 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Deleted allocations for instance 5e80441a-5c23-490f-8fe3-fde7ca91270a
Nov 18 15:34:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:34:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4aa5cbac-e9f0-4d1f-acf6-aa9c6e6dd095 tempest-TaggedBootDevicesTest_v242-1681417481 tempest-TaggedBootDevicesTest_v242-1681417481-project-member] Lock "5e80441a-5c23-490f-8fe3-fde7ca91270a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.999s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Updating instance_info_cache with network_info: [{"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:51 user nova-compute[74839]: WARNING nova.compute.manager [req-0d8a402d-3fed-4f40-a85f-9959a7ec2718 req-f5b37226-0bc3-4d86-9ab0-29fecbea5bb7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state building and task_state spawning.
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Releasing lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Instance network_info: |[{"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] Acquired lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Refreshing network info cache for port 9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Start _get_guest_xml network_info=[{"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:34:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-388930685',display_name='tempest-VolumesAdminNegativeTest-server-388930685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-388930685',id=12,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-4al61zuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:49Z,user_data=None,user_id='162cc08b925a423caa2f868e93dffdee',uuid=0006df13-2c31-4fac-8c3c-f24446ad333d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'pci_devices' on Instance uuid 0006df13-2c31-4fac-8c3c-f24446ad333d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:34:51 user nova-compute[74839]:   <uuid>0006df13-2c31-4fac-8c3c-f24446ad333d</uuid>
Nov 18 15:34:51 user nova-compute[74839]:   <name>instance-0000000c</name>
Nov 18 15:34:51 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:34:51 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:34:51 user nova-compute[74839]:   <metadata>
Nov 18 15:34:51 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:34:51 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:name>tempest-VolumesAdminNegativeTest-server-388930685</nova:name>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:34:51</nova:creationTime>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:34:51 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:34:51 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:owner>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:user uuid="162cc08b925a423caa2f868e93dffdee">tempest-VolumesAdminNegativeTest-375832265-project-member</nova:user>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:project uuid="262e132ce68d4ff9bfd9e25e9e0dd141">tempest-VolumesAdminNegativeTest-375832265</nova:project>
Nov 18 15:34:51 user nova-compute[74839]:       </nova:owner>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:34:51 user nova-compute[74839]:       <nova:ports>
Nov 18 15:34:51 user nova-compute[74839]:         <nova:port uuid="9df8a201-048c-4813-a497-60505dd5b01b">
Nov 18 15:34:51 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 15:34:51 user nova-compute[74839]:         </nova:port>
Nov 18 15:34:51 user nova-compute[74839]:       </nova:ports>
Nov 18 15:34:51 user nova-compute[74839]:     </nova:instance>
Nov 18 15:34:51 user nova-compute[74839]:   </metadata>
Nov 18 15:34:51 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:34:51 user nova-compute[74839]:     <system>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="serial">0006df13-2c31-4fac-8c3c-f24446ad333d</entry>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="uuid">0006df13-2c31-4fac-8c3c-f24446ad333d</entry>
Nov 18 15:34:51 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:34:51 user nova-compute[74839]:     </system>
Nov 18 15:34:51 user nova-compute[74839]:   </sysinfo>
Nov 18 15:34:51 user nova-compute[74839]:   <os>
Nov 18 15:34:51 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:34:51 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:34:51 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:34:51 user nova-compute[74839]:   </os>
Nov 18 15:34:51 user nova-compute[74839]:   <features>
Nov 18 15:34:51 user nova-compute[74839]:     <acpi/>
Nov 18 15:34:51 user nova-compute[74839]:     <apic/>
Nov 18 15:34:51 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:34:51 user nova-compute[74839]:   </features>
Nov 18 15:34:51 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:34:51 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:34:51 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:34:51 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:34:51 user nova-compute[74839]:   </clock>
Nov 18 15:34:51 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:34:51 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:34:51 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:34:51 user nova-compute[74839]:   </cpu>
Nov 18 15:34:51 user nova-compute[74839]:   <devices>
Nov 18 15:34:51 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:34:51 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:34:51 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk"/>
Nov 18 15:34:51 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:34:51 user nova-compute[74839]:     </disk>
Nov 18 15:34:51 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:34:51 user nova-compute[74839]:       <mac address="fa:16:3e:55:1b:a1"/>
Nov 18 15:34:51 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:51 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:34:51 user nova-compute[74839]:       <target dev="tap9df8a201-04"/>
Nov 18 15:34:51 user nova-compute[74839]:     </interface>
Nov 18 15:34:51 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:34:51 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/console.log" append="off"/>
Nov 18 15:34:51 user nova-compute[74839]:     </serial>
Nov 18 15:34:51 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:34:51 user nova-compute[74839]:     <video>
Nov 18 15:34:51 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:51 user nova-compute[74839]:     </video>
Nov 18 15:34:51 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:34:51 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:34:51 user nova-compute[74839]:     </rng>
Nov 18 15:34:51 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:34:51 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:34:51 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:34:51 user nova-compute[74839]:     </memballoon>
Nov 18 15:34:51 user nova-compute[74839]:   </devices>
Nov 18 15:34:51 user nova-compute[74839]: </domain>
Nov 18 15:34:51 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-388930685',display_name='tempest-VolumesAdminNegativeTest-server-388930685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-388930685',id=12,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-4al61zuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:49Z,user_data=None,user_id='162cc08b925a423caa2f868e93dffdee',uuid=0006df13-2c31-4fac-8c3c-f24446ad333d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG os_vif [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2936cfe4-c50e-5405-a386-d6bb6906bb30', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9df8a201-04, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9df8a201-04, col_values=(('qos', UUID('270714f7-7d3e-4354-b46a-f85857fc4475')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9df8a201-04, col_values=(('external_ids', {'iface-id': '9df8a201-048c-4813-a497-60505dd5b01b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1b:a1', 'vm-uuid': '0006df13-2c31-4fac-8c3c-f24446ad333d'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:51 user nova-compute[74839]: INFO os_vif [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04')
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] No VIF found with MAC fa:16:3e:55:1b:a1, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Updated VIF entry in instance network info cache for port 9df8a201-048c-4813-a497-60505dd5b01b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Updating instance_info_cache with network_info: [{"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-af19331f-e6eb-407e-81f5-7bf03854e72a req-a3024742-7f00-4dc8-a873-38f3c5850d67 service nova] Releasing lock "refresh_cache-0006df13-2c31-4fac-8c3c-f24446ad333d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:34:52 user nova-compute[74839]: INFO nova.compute.claims [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Claim successful on node user
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de is timed out.
Nov 18 15:34:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Successfully detached device vdb from instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de from the live domain config.
Nov 18 15:34:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuwgeQdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:34:52 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8eb62-b8c2-45a7-a9f9-12405cbfa291]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:34:52 user nova-compute[74839]: No targets found.
Nov 18 15:34:52 user nova-compute[74839]: iSNS:
Nov 18 15:34:52 user nova-compute[74839]: No targets found.
Nov 18 15:34:52 user nova-compute[74839]: STATIC:
Nov 18 15:34:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:34:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b
Nov 18 15:34:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:34:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:34:52 user nova-compute[74839]: FIRMWARE:
Nov 18 15:34:52 user nova-compute[74839]: No targets found.
Nov 18 15:34:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:34:52 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:34:52 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da91d989-f4aa-42d8-9b14-aedb16791b58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] No waiting events found dispatching network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:52 user nova-compute[74839]: WARNING nova.compute.manager [req-1ff69bff-1bd4-4b62-b2db-bd8f95b0a2a0 req-f6406fa3-6b13-4b21-85ef-90d98551507e service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received unexpected event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b for instance with vm_state building and task_state spawning.
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcb1bbc-1afc-424d-ba84-c3aea35539a9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:52 user nova-compute[74839]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:34:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b (non-flash)
Nov 18 15:34:52 user nova-compute[74839]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:34:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a017fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b'): ({'sdh'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Removing single pathed devices sdh {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578d086-aab3-4b55-825d-2faa41fd7bc9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4826fbc-b939-4d73-816c-ab9ab3ca05f2]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Flushing IO for device /dev/sdh {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:34:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db3639-cac9-478e-afe1-c530f7be1585]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f5d43-d0e2-4948-851a-d6bc8b5e61b7]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] SCSI volumes sdh have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[161cc26e-a6cd-4e72-bdb9-0e7c58b3cb42]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b313d68-3e51-4152-9aa2-4951812c70bc]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260]
Nov 18 15:34:53 user nova-compute[74839]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b, portal: 172.16.0.220,3260] successful.
Nov 18 15:34:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cf8dd9-fe7c-48b2-a5ff-8304602c1a5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05588f5-2a66-4086-9a52-94c1e7c0a90e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] <== disconnect_volume: return (301ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:34:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:34:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance spawned successfully.
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.policy [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd5091855f2647abba05a98492302656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67202285b746fb80c72ae0d42394d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:53 user nova-compute[74839]: WARNING nova.compute.manager [req-a3b1ffbd-6e9a-4747-a2e0-962d7c8680ec req-68a7879e-3445-458c-ab55-9c022299dcdc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state building and task_state spawning.
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:34:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Creating image(s)
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:53 user nova-compute[74839]: INFO nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: INFO nova.compute.manager [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Took 19.29 seconds to build instance.
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9798228a-f73c-46e3-b488-7dee6629c51e tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.430s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk 1073741824" returned: 0 in 0.047s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Successfully created port: 42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:34:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lazy-loading 'flavor' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4b6aab9d-d679-4186-b3bc-fc5f35909a25 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.754s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Cannot resize image /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Ensure instance console log exists: /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Successfully updated port: 42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquired lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-changed-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Refreshing instance network info cache due to event network-changed-42902567-498c-4ab8-94eb-760295084938. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] Acquiring lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating instance_info_cache with network_info: [{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Releasing lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Instance network_info: |[{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] Acquired lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Refreshing network info cache for port 42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Start _get_guest_xml network_info=[{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:34:54 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:54 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323569522',display_name='tempest-AttachVolumeNegativeTest-server-1323569522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323569522',id=13,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrW//d8rc3WZne92bbUKAWSHQl6N62lf3hhLccwuiJe31zkERvBzdGpni+ce10zfhs1rEx8ZcMuBxav8NWhF/HBG38v/ByODZsp8dZ6EWtbktNvr9j739w89m6yrA2UnA==',key_name='tempest-keypair-355814580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-9mwpq8dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a1d1e64c-f034-487e-afe0-c67155ba2984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'pci_devices' on Instance uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:34:54 user nova-compute[74839]:   <uuid>a1d1e64c-f034-487e-afe0-c67155ba2984</uuid>
Nov 18 15:34:54 user nova-compute[74839]:   <name>instance-0000000d</name>
Nov 18 15:34:54 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:34:54 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:34:54 user nova-compute[74839]:   <metadata>
Nov 18 15:34:54 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:34:54 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1323569522</nova:name>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:34:54</nova:creationTime>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:34:54 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:34:54 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:owner>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:user uuid="fd5091855f2647abba05a98492302656">tempest-AttachVolumeNegativeTest-183955382-project-member</nova:user>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:project uuid="9d67202285b746fb80c72ae0d42394d5">tempest-AttachVolumeNegativeTest-183955382</nova:project>
Nov 18 15:34:54 user nova-compute[74839]:       </nova:owner>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:34:54 user nova-compute[74839]:       <nova:ports>
Nov 18 15:34:54 user nova-compute[74839]:         <nova:port uuid="42902567-498c-4ab8-94eb-760295084938">
Nov 18 15:34:54 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 15:34:54 user nova-compute[74839]:         </nova:port>
Nov 18 15:34:54 user nova-compute[74839]:       </nova:ports>
Nov 18 15:34:54 user nova-compute[74839]:     </nova:instance>
Nov 18 15:34:54 user nova-compute[74839]:   </metadata>
Nov 18 15:34:54 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:34:54 user nova-compute[74839]:     <system>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="serial">a1d1e64c-f034-487e-afe0-c67155ba2984</entry>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="uuid">a1d1e64c-f034-487e-afe0-c67155ba2984</entry>
Nov 18 15:34:54 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:34:54 user nova-compute[74839]:     </system>
Nov 18 15:34:54 user nova-compute[74839]:   </sysinfo>
Nov 18 15:34:54 user nova-compute[74839]:   <os>
Nov 18 15:34:54 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:34:54 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:34:54 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:34:54 user nova-compute[74839]:   </os>
Nov 18 15:34:54 user nova-compute[74839]:   <features>
Nov 18 15:34:54 user nova-compute[74839]:     <acpi/>
Nov 18 15:34:54 user nova-compute[74839]:     <apic/>
Nov 18 15:34:54 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:34:54 user nova-compute[74839]:   </features>
Nov 18 15:34:54 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:34:54 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:34:54 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:34:54 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:34:54 user nova-compute[74839]:   </clock>
Nov 18 15:34:54 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:34:54 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:34:54 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:34:54 user nova-compute[74839]:   </cpu>
Nov 18 15:34:54 user nova-compute[74839]:   <devices>
Nov 18 15:34:54 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:34:54 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:34:54 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk"/>
Nov 18 15:34:54 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:34:54 user nova-compute[74839]:     </disk>
Nov 18 15:34:54 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:34:54 user nova-compute[74839]:       <mac address="fa:16:3e:ab:ce:0f"/>
Nov 18 15:34:54 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:54 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:34:54 user nova-compute[74839]:       <target dev="tap42902567-49"/>
Nov 18 15:34:54 user nova-compute[74839]:     </interface>
Nov 18 15:34:54 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:34:54 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/console.log" append="off"/>
Nov 18 15:34:54 user nova-compute[74839]:     </serial>
Nov 18 15:34:54 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:34:54 user nova-compute[74839]:     <video>
Nov 18 15:34:54 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:34:54 user nova-compute[74839]:     </video>
Nov 18 15:34:54 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:34:54 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:34:54 user nova-compute[74839]:     </rng>
Nov 18 15:34:54 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:34:54 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:34:54 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:34:54 user nova-compute[74839]:     </memballoon>
Nov 18 15:34:54 user nova-compute[74839]:   </devices>
Nov 18 15:34:54 user nova-compute[74839]: </domain>
Nov 18 15:34:54 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323569522',display_name='tempest-AttachVolumeNegativeTest-server-1323569522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323569522',id=13,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrW//d8rc3WZne92bbUKAWSHQl6N62lf3hhLccwuiJe31zkERvBzdGpni+ce10zfhs1rEx8ZcMuBxav8NWhF/HBG38v/ByODZsp8dZ6EWtbktNvr9j739w89m6yrA2UnA==',key_name='tempest-keypair-355814580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-9mwpq8dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a1d1e64c-f034-487e-afe0-c67155ba2984,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG os_vif [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1e2e459-f9cc-575e-8df7-19090cf0918d', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42902567-49, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42902567-49, col_values=(('qos', UUID('3dfa108a-fcc5-4883-afae-8f9910dc3c3b')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42902567-49, col_values=(('external_ids', {'iface-id': '42902567-498c-4ab8-94eb-760295084938', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ce:0f', 'vm-uuid': 'a1d1e64c-f034-487e-afe0-c67155ba2984'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:54 user nova-compute[74839]: INFO os_vif [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49')
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] No waiting events found dispatching network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:54 user nova-compute[74839]: WARNING nova.compute.manager [req-2a5ce65b-4209-4f09-bada-b8796fb5ed67 req-209d5999-40ac-4567-863b-b6dbd6339167 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received unexpected event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b for instance with vm_state building and task_state spawning.
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:34:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Instance spawned successfully.
Nov 18 15:34:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:ab:ce:0f, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:34:55 user nova-compute[74839]: INFO nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:34:55 user nova-compute[74839]: INFO nova.compute.manager [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Took 7.03 seconds to build instance.
Nov 18 15:34:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f2f3cf84-9867-4420-a9c9-fe511e5e3632 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.134s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updated VIF entry in instance network info cache for port 42902567-498c-4ab8-94eb-760295084938. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating instance_info_cache with network_info: [{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:34:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49bf49b3-4be8-43b0-bb32-dfe97d0ebb50 req-e4281701-dab4-49d7-be5f-5b9833dc70dc service nova] Releasing lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] No waiting events found dispatching network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:56 user nova-compute[74839]: WARNING nova.compute.manager [req-d05df069-6b3b-4346-b535-1cb8ebaed9f8 req-ce01dd4d-ec04-4fff-b540-f2c0fded8912 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received unexpected event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 for instance with vm_state building and task_state spawning.
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:34:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Instance spawned successfully.
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:34:58 user nova-compute[74839]: INFO nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:34:58 user nova-compute[74839]: INFO nova.compute.manager [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Took 6.16 seconds to build instance.
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] No waiting events found dispatching network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:34:58 user nova-compute[74839]: WARNING nova.compute.manager [req-8dd760bb-91bc-4cac-b386-b4d3275d774c req-6c3dc86c-b0e0-41d3-96b5-8c25d1cd4556 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received unexpected event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 for instance with vm_state active and task_state None.
Nov 18 15:34:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd0a2a77-4205-495c-911d-923d068b87d3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.269s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:34:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:34:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:00 user nova-compute[74839]: INFO nova.compute.manager [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Terminating instance
Nov 18 15:35:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-unplugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] No waiting events found dispatching network-vif-unplugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-8cd7ab26-9061-40cc-939b-7196f23c88f0 req-77cbe9e1-814e-4027-82b6-79ab4d7fc7d4 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-unplugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:35:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Instance destroyed successfully.
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lazy-loading 'resources' on Instance uuid 25559075-a7fe-464c-a454-3c7cdd8c0f51 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1090325979',display_name='tempest-VolumesAssistedSnapshotsTest-server-1090325979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1090325979',id=6,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjsR2oXGyiZkIleQTgKCm4Q2/UNWGTd4B14WLtzMh/ULp+jyjku5wr0e8KTrfZL0EdKX7E/B+lkvPrVMmRL7yciYqXMH2r+Myr0c57MhHKKcWEW6JSD8RAcnxXIx5urSw==',key_name='tempest-keypair-156532242',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bed18c2a39944aca637c4cf993084f7',ramdisk_id='',reservation_id='r-mx8le3rm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1491695643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1491695643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82f9d6235e574da1b7f600431a508e42',uuid=25559075-a7fe-464c-a454-3c7cdd8c0f51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converting VIF {"id": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "address": "fa:16:3e:b6:d1:40", "network": {"id": "e7ce2fa5-1e3f-4868-968f-98cc3b9c074f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-504461291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bed18c2a39944aca637c4cf993084f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57cb73b7-37", "ovs_interfaceid": "57cb73b7-3769-484e-9ab8-24c8b8b26dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG os_vif [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57cb73b7-37, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f450a783-9792-4184-b827-4b4907718394) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:01 user nova-compute[74839]: INFO os_vif [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d1:40,bridge_name='br-int',has_traffic_filtering=True,id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb,network=Network(e7ce2fa5-1e3f-4868-968f-98cc3b9c074f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57cb73b7-37')
Nov 18 15:35:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Deleting instance files /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51_del
Nov 18 15:35:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Deletion of /opt/stack/data/nova/instances/25559075-a7fe-464c-a454-3c7cdd8c0f51_del complete
Nov 18 15:35:01 user nova-compute[74839]: INFO nova.compute.manager [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 18 15:35:01 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:35:01 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:35:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Waiting for libvirt event about the detach of device tapec364259-ff with device alias net1 from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b is timed out.
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface> {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:33:f9:d9"/><model type="virtio"/><mtu size="1442"/><target dev="tapec364259-ff"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 18 15:35:02 user nova-compute[74839]:   <name>instance-00000008</name>
Nov 18 15:35:02 user nova-compute[74839]:   <uuid>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</uuid>
Nov 18 15:35:02 user nova-compute[74839]:   <metadata>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:35:02 user nova-compute[74839]:   <nova:package version="0.0.0"/>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:name>tempest-device-tagging-server-178092732</nova:name>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:creationTime>2023-11-18 15:34:07</nova:creationTime>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:flavor name="m1.tiny">
Nov 18 15:35:02 user nova-compute[74839]:     <nova:memory>512</nova:memory>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:disk>1</nova:disk>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:swap>0</nova:swap>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:vcpus>1</nova:vcpus>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:flavor>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:owner>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:user uuid="5c2f377a54cb47a492e284d02a4781d4">tempest-TaggedAttachmentsTest-2005585609-project-member</nova:user>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:project uuid="84720179af9a446fa15a13fedf97ddee">tempest-TaggedAttachmentsTest-2005585609</nova:project>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:owner>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:ports>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:port uuid="fc17681d-3b08-4bd1-9d73-53a7b9d3cda4">
Nov 18 15:35:02 user nova-compute[74839]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:35:02 user nova-compute[74839]:     </nova:port>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:port uuid="ec364259-ff2b-41d2-80f3-9dfeb7824932">
Nov 18 15:35:02 user nova-compute[74839]:       <nova:ip type="fixed" address="10.10.10.141" ipVersion="4"/>
Nov 18 15:35:02 user nova-compute[74839]:     </nova:port>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:ports>
Nov 18 15:35:02 user nova-compute[74839]: </nova:instance>
Nov 18 15:35:02 user nova-compute[74839]:   </metadata>
Nov 18 15:35:02 user nova-compute[74839]:   <memory unit='KiB'>524288</memory>
Nov 18 15:35:02 user nova-compute[74839]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 18 15:35:02 user nova-compute[74839]:   <vcpu placement='static'>1</vcpu>
Nov 18 15:35:02 user nova-compute[74839]:   <resource>
Nov 18 15:35:02 user nova-compute[74839]:     <partition>/machine</partition>
Nov 18 15:35:02 user nova-compute[74839]:   </resource>
Nov 18 15:35:02 user nova-compute[74839]:   <sysinfo type='smbios'>
Nov 18 15:35:02 user nova-compute[74839]:     <system>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='product'>OpenStack Nova</entry>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='version'>0.0.0</entry>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='serial'>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='uuid'>59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</entry>
Nov 18 15:35:02 user nova-compute[74839]:       <entry name='family'>Virtual Machine</entry>
Nov 18 15:35:02 user nova-compute[74839]:     </system>
Nov 18 15:35:02 user nova-compute[74839]:   </sysinfo>
Nov 18 15:35:02 user nova-compute[74839]:   <os>
Nov 18 15:35:02 user nova-compute[74839]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 18 15:35:02 user nova-compute[74839]:     <boot dev='hd'/>
Nov 18 15:35:02 user nova-compute[74839]:     <smbios mode='sysinfo'/>
Nov 18 15:35:02 user nova-compute[74839]:   </os>
Nov 18 15:35:02 user nova-compute[74839]:   <features>
Nov 18 15:35:02 user nova-compute[74839]:     <acpi/>
Nov 18 15:35:02 user nova-compute[74839]:     <apic/>
Nov 18 15:35:02 user nova-compute[74839]:     <vmcoreinfo state='on'/>
Nov 18 15:35:02 user nova-compute[74839]:   </features>
Nov 18 15:35:02 user nova-compute[74839]:   <cpu mode='custom' match='exact' check='full'>
Nov 18 15:35:02 user nova-compute[74839]:     <model fallback='forbid'>Nehalem</model>
Nov 18 15:35:02 user nova-compute[74839]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 18 15:35:02 user nova-compute[74839]:     <feature policy='require' name='vme'/>
Nov 18 15:35:02 user nova-compute[74839]:     <feature policy='require' name='x2apic'/>
Nov 18 15:35:02 user nova-compute[74839]:     <feature policy='require' name='hypervisor'/>
Nov 18 15:35:02 user nova-compute[74839]:   </cpu>
Nov 18 15:35:02 user nova-compute[74839]:   <clock offset='utc'>
Nov 18 15:35:02 user nova-compute[74839]:     <timer name='pit' tickpolicy='delay'/>
Nov 18 15:35:02 user nova-compute[74839]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 18 15:35:02 user nova-compute[74839]:     <timer name='hpet' present='no'/>
Nov 18 15:35:02 user nova-compute[74839]:   </clock>
Nov 18 15:35:02 user nova-compute[74839]:   <on_poweroff>destroy</on_poweroff>
Nov 18 15:35:02 user nova-compute[74839]:   <on_reboot>restart</on_reboot>
Nov 18 15:35:02 user nova-compute[74839]:   <on_crash>destroy</on_crash>
Nov 18 15:35:02 user nova-compute[74839]:   <devices>
Nov 18 15:35:02 user nova-compute[74839]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 18 15:35:02 user nova-compute[74839]:     <disk type='file' device='disk'>
Nov 18 15:35:02 user nova-compute[74839]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 18 15:35:02 user nova-compute[74839]:       <source file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk' index='2'/>
Nov 18 15:35:02 user nova-compute[74839]:       <backingStore type='file' index='3'>
Nov 18 15:35:02 user nova-compute[74839]:         <format type='raw'/>
Nov 18 15:35:02 user nova-compute[74839]:         <source file='/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9'/>
Nov 18 15:35:02 user nova-compute[74839]:         <backingStore/>
Nov 18 15:35:02 user nova-compute[74839]:       </backingStore>
Nov 18 15:35:02 user nova-compute[74839]:       <target dev='vda' bus='virtio'/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='virtio-disk0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </disk>
Nov 18 15:35:02 user nova-compute[74839]:     <disk type='file' device='cdrom'>
Nov 18 15:35:02 user nova-compute[74839]:       <driver name='qemu' type='raw' cache='none'/>
Nov 18 15:35:02 user nova-compute[74839]:       <source file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/disk.config' index='1'/>
Nov 18 15:35:02 user nova-compute[74839]:       <backingStore/>
Nov 18 15:35:02 user nova-compute[74839]:       <target dev='hda' bus='ide'/>
Nov 18 15:35:02 user nova-compute[74839]:       <readonly/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='ide0-0-0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </disk>
Nov 18 15:35:02 user nova-compute[74839]:     <controller type='usb' index='0' model='none'>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='usb'/>
Nov 18 15:35:02 user nova-compute[74839]:     </controller>
Nov 18 15:35:02 user nova-compute[74839]:     <controller type='pci' index='0' model='pci-root'>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='pci.0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </controller>
Nov 18 15:35:02 user nova-compute[74839]:     <controller type='ide' index='0'>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='ide'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 18 15:35:02 user nova-compute[74839]:     </controller>
Nov 18 15:35:02 user nova-compute[74839]:     <interface type='ethernet'>
Nov 18 15:35:02 user nova-compute[74839]:       <mac address='fa:16:3e:1d:12:ab'/>
Nov 18 15:35:02 user nova-compute[74839]:       <target dev='tapfc17681d-3b'/>
Nov 18 15:35:02 user nova-compute[74839]:       <model type='virtio'/>
Nov 18 15:35:02 user nova-compute[74839]:       <mtu size='1442'/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='net0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </interface>
Nov 18 15:35:02 user nova-compute[74839]:     <serial type='pty'>
Nov 18 15:35:02 user nova-compute[74839]:       <source path='/dev/pts/7'/>
Nov 18 15:35:02 user nova-compute[74839]:       <log file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log' append='off'/>
Nov 18 15:35:02 user nova-compute[74839]:       <target type='isa-serial' port='0'>
Nov 18 15:35:02 user nova-compute[74839]:         <model name='isa-serial'/>
Nov 18 15:35:02 user nova-compute[74839]:       </target>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='serial0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </serial>
Nov 18 15:35:02 user nova-compute[74839]:     <console type='pty' tty='/dev/pts/7'>
Nov 18 15:35:02 user nova-compute[74839]:       <source path='/dev/pts/7'/>
Nov 18 15:35:02 user nova-compute[74839]:       <log file='/opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b/console.log' append='off'/>
Nov 18 15:35:02 user nova-compute[74839]:       <target type='serial' port='0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='serial0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </console>
Nov 18 15:35:02 user nova-compute[74839]:     <input type='mouse' bus='ps2'>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='input0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </input>
Nov 18 15:35:02 user nova-compute[74839]:     <input type='keyboard' bus='ps2'>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='input1'/>
Nov 18 15:35:02 user nova-compute[74839]:     </input>
Nov 18 15:35:02 user nova-compute[74839]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 18 15:35:02 user nova-compute[74839]:       <listen type='address' address='0.0.0.0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </graphics>
Nov 18 15:35:02 user nova-compute[74839]:     <audio id='1' type='none'/>
Nov 18 15:35:02 user nova-compute[74839]:     <video>
Nov 18 15:35:02 user nova-compute[74839]:       <model type='virtio' heads='1' primary='yes'/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='video0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </video>
Nov 18 15:35:02 user nova-compute[74839]:     <memballoon model='virtio'>
Nov 18 15:35:02 user nova-compute[74839]:       <stats period='10'/>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='balloon0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </memballoon>
Nov 18 15:35:02 user nova-compute[74839]:     <rng model='virtio'>
Nov 18 15:35:02 user nova-compute[74839]:       <backend model='random'>/dev/urandom</backend>
Nov 18 15:35:02 user nova-compute[74839]:       <alias name='rng0'/>
Nov 18 15:35:02 user nova-compute[74839]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 18 15:35:02 user nova-compute[74839]:     </rng>
Nov 18 15:35:02 user nova-compute[74839]:   </devices>
Nov 18 15:35:02 user nova-compute[74839]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 18 15:35:02 user nova-compute[74839]:     <label>libvirt-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</label>
Nov 18 15:35:02 user nova-compute[74839]:     <imagelabel>libvirt-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b</imagelabel>
Nov 18 15:35:02 user nova-compute[74839]:   </seclabel>
Nov 18 15:35:02 user nova-compute[74839]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 18 15:35:02 user nova-compute[74839]:     <label>+64055:+108</label>
Nov 18 15:35:02 user nova-compute[74839]:     <imagelabel>+64055:+108</imagelabel>
Nov 18 15:35:02 user nova-compute[74839]:   </seclabel>
Nov 18 15:35:02 user nova-compute[74839]: </domain>
Nov 18 15:35:02 user nova-compute[74839]:  {{(pid=74839) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 18 15:35:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully detached device tapec364259-ff from instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b from the live domain config.
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "address": "fa:16:3e:33:f9:d9", "network": {"id": "01d297aa-bed5-4700-ab21-e7817dafe686", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-845146854", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec364259-ff", "ovs_interfaceid": "ec364259-ff2b-41d2-80f3-9dfeb7824932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG os_vif [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec364259-ff, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caf0e066-0bbc-4e51-bbbd-bb31f8f3215c) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:02 user nova-compute[74839]: INFO os_vif [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:f9:d9,bridge_name='br-int',has_traffic_filtering=True,id=ec364259-ff2b-41d2-80f3-9dfeb7824932,network=Network(01d297aa-bed5-4700-ab21-e7817dafe686),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec364259-ff')
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:35:02 user nova-compute[74839]:   <nova:package version="0.0.0"/>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:name>tempest-device-tagging-server-178092732</nova:name>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:creationTime>2023-11-18 15:35:02</nova:creationTime>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:flavor name="m1.tiny">
Nov 18 15:35:02 user nova-compute[74839]:     <nova:memory>512</nova:memory>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:disk>1</nova:disk>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:swap>0</nova:swap>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:vcpus>1</nova:vcpus>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:flavor>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:owner>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:user uuid="5c2f377a54cb47a492e284d02a4781d4">tempest-TaggedAttachmentsTest-2005585609-project-member</nova:user>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:project uuid="84720179af9a446fa15a13fedf97ddee">tempest-TaggedAttachmentsTest-2005585609</nova:project>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:owner>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:35:02 user nova-compute[74839]:   <nova:ports>
Nov 18 15:35:02 user nova-compute[74839]:     <nova:port uuid="fc17681d-3b08-4bd1-9d73-53a7b9d3cda4">
Nov 18 15:35:02 user nova-compute[74839]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:35:02 user nova-compute[74839]:     </nova:port>
Nov 18 15:35:02 user nova-compute[74839]:   </nova:ports>
Nov 18 15:35:02 user nova-compute[74839]: </nova:instance>
Nov 18 15:35:02 user nova-compute[74839]:  {{(pid=74839) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-da6a76d4-e25c-4d49-b953-7a6c90e4c84e req-cf8f3964-5fac-4225-9c1f-2040d533e602 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-deleted-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:02 user nova-compute[74839]: INFO nova.compute.manager [req-da6a76d4-e25c-4d49-b953-7a6c90e4c84e req-cf8f3964-5fac-4225-9c1f-2040d533e602 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Neutron deleted interface 57cb73b7-3769-484e-9ab8-24c8b8b26dcb; detaching it from the instance and deleting it from the info cache
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.network.neutron [req-da6a76d4-e25c-4d49-b953-7a6c90e4c84e req-cf8f3964-5fac-4225-9c1f-2040d533e602 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:02 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Took 1.13 seconds to deallocate network for instance.
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-da6a76d4-e25c-4d49-b953-7a6c90e4c84e req-cf8f3964-5fac-4225-9c1f-2040d533e602 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Detach interface failed, port_id=57cb73b7-3769-484e-9ab8-24c8b8b26dcb, reason: Instance 25559075-a7fe-464c-a454-3c7cdd8c0f51 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquired lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:35:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:35:02 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Deleted allocations for instance 25559075-a7fe-464c-a454-3c7cdd8c0f51
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c9b09e3a-3277-48ba-84e5-7089b86d45a4 tempest-VolumesAssistedSnapshotsTest-1491695643 tempest-VolumesAssistedSnapshotsTest-1491695643-project-member] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.682s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] Acquiring lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] Lock "25559075-a7fe-464c-a454-3c7cdd8c0f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] No waiting events found dispatching network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:03 user nova-compute[74839]: WARNING nova.compute.manager [req-02646091-beac-470b-a895-8ffe460132f3 req-1637f94c-0846-4603-b00c-c695fe092301 service nova] [instance: 25559075-a7fe-464c-a454-3c7cdd8c0f51] Received unexpected event network-vif-plugged-57cb73b7-3769-484e-9ab8-24c8b8b26dcb for instance with vm_state deleted and task_state None.
Nov 18 15:35:03 user nova-compute[74839]: INFO nova.network.neutron [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Port ec364259-ff2b-41d2-80f3-9dfeb7824932 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 18 15:35:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [{"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Releasing lock "refresh_cache-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:35:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b02cadc-0643-43a4-bc1b-3db70d2a44d0 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "interface-59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-ec364259-ff2b-41d2-80f3-9dfeb7824932" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.580s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-acb1c8b0-1ee6-434f-a609-34094dbe2e07 req-b657f1d1-6e55-49ea-878c-1e08c054149f service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-deleted-ec364259-ff2b-41d2-80f3-9dfeb7824932 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:22 user nova-compute[74839]: INFO nova.compute.manager [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Terminating instance
Nov 18 15:35:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-unplugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] No waiting events found dispatching network-vif-unplugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-d62a16fc-de62-4f02-9301-690244e1f707 req-0f43bd26-b4cf-4c30-a8ce-3a4ca0b6276e service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-unplugged-68399f97-b18a-47c7-8146-12c90804cb6d for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Instance destroyed successfully.
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lazy-loading 'resources' on Instance uuid 4519ea92-d2c5-4871-a69e-fa50a3fcf6de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-108973333',display_name='tempest-TestVolumeSwap-server-108973333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-108973333',id=5,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXk2ENJ/jNdXOucJMBtH05ArRrZN8dEKkJGTbFaTi+mJTgJ9eHnZCjONCrEb7O+QcQUhahh/qXP2JtvGyupsDGcUm1oqdhkHKO3shMcMa/lSJEtXgA5JiiRvEZV2y9JTg==',key_name='tempest-keypair-212807957',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='539debd6bd2f43b99eb36d50a5baab91',ramdisk_id='',reservation_id='r-t4oalpda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1822157254',owner_user_name='tempest-TestVolumeSwap-1822157254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1aa588cc9b9642a48c99d8338c651235',uuid=4519ea92-d2c5-4871-a69e-fa50a3fcf6de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converting VIF {"id": "68399f97-b18a-47c7-8146-12c90804cb6d", "address": "fa:16:3e:5c:82:92", "network": {"id": "ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1491010915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "539debd6bd2f43b99eb36d50a5baab91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68399f97-b1", "ovs_interfaceid": "68399f97-b18a-47c7-8146-12c90804cb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG os_vif [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68399f97-b1, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=222db6a9-4830-444d-845e-5220daa28b34) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:23 user nova-compute[74839]: INFO os_vif [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:82:92,bridge_name='br-int',has_traffic_filtering=True,id=68399f97-b18a-47c7-8146-12c90804cb6d,network=Network(ed7f5bb5-67fe-41f2-92bc-1c91a4c13c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68399f97-b1')
Nov 18 15:35:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Deleting instance files /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de_del
Nov 18 15:35:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Deletion of /opt/stack/data/nova/instances/4519ea92-d2c5-4871-a69e-fa50a3fcf6de_del complete
Nov 18 15:35:23 user nova-compute[74839]: INFO nova.compute.manager [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 15:35:23 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:35:23 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:24 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Took 0.65 seconds to deallocate network for instance.
Nov 18 15:35:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-60456d6a-e1ce-47e6-9bab-f07952a18d92 req-ef133422-5f1a-40a8-8324-9b248d735a97 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-deleted-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:35:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:24 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Deleted allocations for instance 4519ea92-d2c5-4871-a69e-fa50a3fcf6de
Nov 18 15:35:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c537cd5-0b31-4dd6-a49f-9e2c032c2872 tempest-TestVolumeSwap-1822157254 tempest-TestVolumeSwap-1822157254-project-member] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:25 user nova-compute[74839]: DEBUG nova.compute.manager [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] Acquiring lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] Lock "4519ea92-d2c5-4871-a69e-fa50a3fcf6de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:25 user nova-compute[74839]: DEBUG nova.compute.manager [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] No waiting events found dispatching network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:25 user nova-compute[74839]: WARNING nova.compute.manager [req-eab4a73e-876e-4f4c-b5aa-8f044cb57273 req-04ba4334-6cba-4a94-87d1-beadf9768f10 service nova] [instance: 4519ea92-d2c5-4871-a69e-fa50a3fcf6de] Received unexpected event network-vif-plugged-68399f97-b18a-47c7-8146-12c90804cb6d for instance with vm_state deleted and task_state None.
Nov 18 15:35:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:30 user nova-compute[74839]: INFO nova.compute.manager [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Unshelving
Nov 18 15:35:30 user nova-compute[74839]: INFO nova.virt.block_device [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Booting with volume 6a7ef761-4f88-4609-9d83-61468920bd8d at /dev/vdc
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc47b224-e439-4560-a7e6-633fb0933150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d309f7b-250c-4697-8c28-04da80266298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ffea2-d2c8-4dd5-b6c4-9b1c9cdd315c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c10bb-f834-44cf-a0fe-9178d12af09f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:35:30 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:35:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1be8b-4179-49bd-9ace-e1672b352a22]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:35:30 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating existing volume attachment record: 840a01c8-cc9a-415b-bba8-c65d0f180659 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:32 user nova-compute[74839]: INFO nova.compute.manager [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Terminating instance
Nov 18 15:35:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-unplugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-unplugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c0f0332-bffc-4076-9111-b84fde7f1945 req-c8369e5c-944a-441c-979e-26c068ef431e service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-unplugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Instance destroyed successfully.
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lazy-loading 'resources' on Instance uuid 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:32:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-178092732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-178092732',id=8,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqOYaKscojQFM6unpICXTLEI4HJdsO6VO4106jemhjRs5Grz4b6ccBVviQkRrEbyt5MNg1q2KOkIXSrLtI0luqFUSFPirO+e+IsVaBHheyBYely8dPKejcTka21MXe0vQ==',key_name='tempest-keypair-1871624125',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84720179af9a446fa15a13fedf97ddee',ramdisk_id='',reservation_id='r-amb7db2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2005585609',owner_user_name='tempest-TaggedAttachmentsTest-2005585609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c2f377a54cb47a492e284d02a4781d4',uuid=59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converting VIF {"id": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "address": "fa:16:3e:1d:12:ab", "network": {"id": "62b7c974-6d31-4b7c-a10d-6dd9dd97d591", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-779009675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84720179af9a446fa15a13fedf97ddee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc17681d-3b", "ovs_interfaceid": "fc17681d-3b08-4bd1-9d73-53a7b9d3cda4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG os_vif [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc17681d-3b, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dd9a3ec-fcfc-44f2-8397-66853bfea610) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:33 user nova-compute[74839]: INFO os_vif [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:12:ab,bridge_name='br-int',has_traffic_filtering=True,id=fc17681d-3b08-4bd1-9d73-53a7b9d3cda4,network=Network(62b7c974-6d31-4b7c-a10d-6dd9dd97d591),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc17681d-3b')
Nov 18 15:35:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Deleting instance files /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b_del
Nov 18 15:35:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Deletion of /opt/stack/data/nova/instances/59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b_del complete
Nov 18 15:35:33 user nova-compute[74839]: INFO nova.compute.manager [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 18 15:35:33 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:35:33 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:34 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Took 0.70 seconds to deallocate network for instance.
Nov 18 15:35:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f41eab5-66f4-46fa-b62e-f672118abee3 req-e954c7c1-5dbe-4226-a9f8-080ba96012c3 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-deleted-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:35:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:34 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Deleted allocations for instance 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b
Nov 18 15:35:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d0ed0613-d253-4108-8951-fd95039c39b7 tempest-TaggedAttachmentsTest-2005585609 tempest-TaggedAttachmentsTest-2005585609-project-member] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] Acquiring lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] Lock "59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] No waiting events found dispatching network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:35 user nova-compute[74839]: WARNING nova.compute.manager [req-5fb18887-d811-4c4d-bb7d-2491b26e086a req-b0d87e29-9f88-4be4-b410-ab515040d935 service nova] [instance: 59fcbf5d-f4f0-44e3-a2f2-d5fb3d0c633b] Received unexpected event network-vif-plugged-fc17681d-3b08-4bd1-9d73-53a7b9d3cda4 for instance with vm_state deleted and task_state None.
Nov 18 15:35:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_requests' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'numa_topology' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:35:39 user nova-compute[74839]: INFO nova.compute.claims [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Claim successful on node user
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:39 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:35:39 user nova-compute[74839]: INFO nova.network.neutron [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating port 426cda54-c5b6-404c-bba7-727c58ec4952 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing instance network info cache due to event network-changed-426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:35:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Creating image(s)
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'trusted_certs' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Refreshing network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG nova.objects.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<21d73872-2b83-48b1-b465-9309a293ad81> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.986s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG nova.virt.images [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] 4898227b-fd87-4219-80b8-700f16d9b56c was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.part /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updated VIF entry in instance network info cache for port 426cda54-c5b6-404c-bba7-727c58ec4952. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8899dcc0-fe56-45d7-b4b9-8f75280379c6 req-11ca5ed3-151a-4dbd-b957-2e342d94044b service nova] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.part /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.converted" returned: 0 in 0.664s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:35:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8246MB free_disk=25.67180633544922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 0006df13-2c31-4fac-8c3c-f24446ad333d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a1d1e64c-f034-487e-afe0-c67155ba2984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (1b2bc3b9-1976-45c0-acc1-6705a8c2df60): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.101s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json" returned: 0 in 0.251s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json" returned: 0 in 0.220s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc,backing_fmt=raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc,backing_fmt=raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk 1073741824" returned: 0 in 0.054s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "23029d0c5bf105b84f89602eaeed60f53dd8afcc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc --force-share --output=json" returned: 0 in 0.252s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:43 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'migration_context' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:44 user nova-compute[74839]: DEBUG nova.objects.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<21d73872-2b83-48b1-b465-9309a293ad81> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:35:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Rebasing disk image.
Nov 18 15:35:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 -F raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 -F raw /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk" returned: 0 in 1.926s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Ensure instance console log exists: /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start _get_guest_xml network_info=[{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d027d6af3719accd978932a92a9c7084',container_format='bare',created_at=2023-11-18T15:33:38Z,direct_url=<?>,disk_format='qcow2',id=4898227b-fd87-4219-80b8-700f16d9b56c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-368053819-shelved',owner='9bfa5a922984458fbccbdebc0a906763',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T15:33:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '840a01c8-cc9a-415b-bba8-c65d0f180659', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGgTSIiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '21d73872-2b83-48b1-b465-9309a293ad81', 'attached_at': '', 'detached_at': '', 'volume_id': '6a7ef761-4f88-4609-9d83-61468920bd8d', 'serial': '6a7ef761-4f88-4609-9d83-61468920bd8d'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:35:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:35:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d027d6af3719accd978932a92a9c7084',container_format='bare',created_at=2023-11-18T15:33:38Z,direct_url=<?>,disk_format='qcow2',id=4898227b-fd87-4219-80b8-700f16d9b56c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-368053819-shelved',owner='9bfa5a922984458fbccbdebc0a906763',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T15:33:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'vcpu_model' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.objects.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<21d73872-2b83-48b1-b465-9309a293ad81> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGgTSIiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:35:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:35:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:35:46 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cfd5a3-9d99-4648-a6b0-ff90121fe794]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:35:46 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed21ecb3-afcb-44f6-8ab1-b555fbfe634a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d] added
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa880db0-65e6-4f03-baf6-ba6626b43298]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb15a4-cb52-4ef3-b684-7aca6f072402]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGgTSIiL {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGgTSIiL" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d455068-75a4-44ef-9ec7-21533ca5c6df]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGgTSIiL'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.096s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f31b7-4d65-4116-a487-d6fda49bdddc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c3319-3ad9-4d66-b100-e4c846ede2b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[616434a3-f355-4a2b-8d0c-f915ae094dde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260]
Nov 18 15:35:46 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260] successful.
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2286cea-7632-4b9e-8f4c-5276cc090653]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4946d-6635-4165-92e0-44261a588efc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:35:46 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:35:46 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:35:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b655d6-836a-46f0-8964-66aa87b526ea]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:35:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGgTSIiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23639363435653161', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639363435653161', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='4898227b-fd87-4219-80b8-700f16d9b56c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-494084705',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:33:42.808030',shelved_host='user',shelved_image_id='4898227b-fd87-4219-80b8-700f16d9b56c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:35:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.objects.base [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<21d73872-2b83-48b1-b465-9309a293ad81> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:35:47 user nova-compute[74839]:   <uuid>21d73872-2b83-48b1-b465-9309a293ad81</uuid>
Nov 18 15:35:47 user nova-compute[74839]:   <name>instance-00000003</name>
Nov 18 15:35:47 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:35:47 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:35:47 user nova-compute[74839]:   <metadata>
Nov 18 15:35:47 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:35:47 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-368053819</nova:name>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:35:46</nova:creationTime>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:35:47 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:35:47 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:owner>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:user uuid="7acc8cec037e4e0081c72125cc4c6db9">tempest-AttachVolumeShelveTestJSON-619260582-project-member</nova:user>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:project uuid="9bfa5a922984458fbccbdebc0a906763">tempest-AttachVolumeShelveTestJSON-619260582</nova:project>
Nov 18 15:35:47 user nova-compute[74839]:       </nova:owner>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:root type="image" uuid="4898227b-fd87-4219-80b8-700f16d9b56c"/>
Nov 18 15:35:47 user nova-compute[74839]:       <nova:ports>
Nov 18 15:35:47 user nova-compute[74839]:         <nova:port uuid="426cda54-c5b6-404c-bba7-727c58ec4952">
Nov 18 15:35:47 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:35:47 user nova-compute[74839]:         </nova:port>
Nov 18 15:35:47 user nova-compute[74839]:       </nova:ports>
Nov 18 15:35:47 user nova-compute[74839]:     </nova:instance>
Nov 18 15:35:47 user nova-compute[74839]:   </metadata>
Nov 18 15:35:47 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:35:47 user nova-compute[74839]:     <system>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="serial">21d73872-2b83-48b1-b465-9309a293ad81</entry>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="uuid">21d73872-2b83-48b1-b465-9309a293ad81</entry>
Nov 18 15:35:47 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:35:47 user nova-compute[74839]:     </system>
Nov 18 15:35:47 user nova-compute[74839]:   </sysinfo>
Nov 18 15:35:47 user nova-compute[74839]:   <os>
Nov 18 15:35:47 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:35:47 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:35:47 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:35:47 user nova-compute[74839]:   </os>
Nov 18 15:35:47 user nova-compute[74839]:   <features>
Nov 18 15:35:47 user nova-compute[74839]:     <acpi/>
Nov 18 15:35:47 user nova-compute[74839]:     <apic/>
Nov 18 15:35:47 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:35:47 user nova-compute[74839]:   </features>
Nov 18 15:35:47 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:35:47 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:35:47 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:35:47 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:35:47 user nova-compute[74839]:   </clock>
Nov 18 15:35:47 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:35:47 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:35:47 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:35:47 user nova-compute[74839]:   </cpu>
Nov 18 15:35:47 user nova-compute[74839]:   <devices>
Nov 18 15:35:47 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:35:47 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:35:47 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk"/>
Nov 18 15:35:47 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:35:47 user nova-compute[74839]:     </disk>
Nov 18 15:35:47 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:35:47 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:35:47 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 15:35:47 user nova-compute[74839]:       <target dev="vdc" bus="virtio"/>
Nov 18 15:35:47 user nova-compute[74839]:       <serial>6a7ef761-4f88-4609-9d83-61468920bd8d</serial>
Nov 18 15:35:47 user nova-compute[74839]:     </disk>
Nov 18 15:35:47 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:35:47 user nova-compute[74839]:       <mac address="fa:16:3e:27:06:86"/>
Nov 18 15:35:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:35:47 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:35:47 user nova-compute[74839]:       <target dev="tap426cda54-c5"/>
Nov 18 15:35:47 user nova-compute[74839]:     </interface>
Nov 18 15:35:47 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:35:47 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/console.log" append="off"/>
Nov 18 15:35:47 user nova-compute[74839]:     </serial>
Nov 18 15:35:47 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:35:47 user nova-compute[74839]:     <video>
Nov 18 15:35:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:35:47 user nova-compute[74839]:     </video>
Nov 18 15:35:47 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:35:47 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:35:47 user nova-compute[74839]:     </rng>
Nov 18 15:35:47 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:35:47 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:35:47 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:35:47 user nova-compute[74839]:     </memballoon>
Nov 18 15:35:47 user nova-compute[74839]:   </devices>
Nov 18 15:35:47 user nova-compute[74839]: </domain>
Nov 18 15:35:47 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='4898227b-fd87-4219-80b8-700f16d9b56c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-494084705',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:33:42.808030',shelved_host='user',shelved_image_id='4898227b-fd87-4219-80b8-700f16d9b56c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:35:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG os_vif [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0aeb0a3f-525a-57e4-a27e-378853090d50', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap426cda54-c5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap426cda54-c5, col_values=(('qos', UUID('7b7f3b32-81b1-43de-bd05-ce51fee5356f')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap426cda54-c5, col_values=(('external_ids', {'iface-id': '426cda54-c5b6-404c-bba7-727c58ec4952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:06:86', 'vm-uuid': '21d73872-2b83-48b1-b465-9309a293ad81'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:47 user nova-compute[74839]: INFO os_vif [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5')
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:35:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No VIF found with MAC fa:16:3e:27:06:86, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:35:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:49 user nova-compute[74839]: WARNING nova.compute.manager [req-201b1fbe-c209-4b2d-980c-c1fe933202b0 req-29303114-e04b-4e46-879e-1d40537255c7 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:35:51 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance spawned successfully.
Nov 18 15:35:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:35:51 user nova-compute[74839]: WARNING nova.compute.manager [req-419c5244-db9d-4f38-a352-a72ba78108ae req-59ca1e78-809a-4fdd-a846-eb7c5e7de375 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:35:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:35:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1cf43633-2004-4f7b-9481-0b5095742cf4 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.301s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:35:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:35:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:36:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:36:11 user nova-compute[74839]: INFO nova.compute.claims [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Claim successful on node user
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:36:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:36:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Creating image(s)
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "/opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "/opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "/opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG nova.policy [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe71f67638fc4852be687d3b6c088cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8cdb2242cc143049e8596a1137cb6bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk 1073741824" returned: 0 in 0.049s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Cannot resize image /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Ensure instance console log exists: /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:13 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Successfully created port: 0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Successfully updated port: 0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquired lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-changed-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Refreshing instance network info cache due to event network-changed-0c5ce580-9e2d-4243-81ba-200d07d88b95. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] Acquiring lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Updating instance_info_cache with network_info: [{"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Releasing lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Instance network_info: |[{"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] Acquired lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Refreshing network info cache for port 0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Start _get_guest_xml network_info=[{"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:36:14 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:14 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-444746231',display_name='tempest-VolumesNegativeTest-instance-444746231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-444746231',id=14,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cdb2242cc143049e8596a1137cb6bc',ramdisk_id='',reservation_id='r-e1liqf60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1084718722',owner_user_name='tempest-VolumesNegativeTest-1084718722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:12Z,user_data=None,user_id='fe71f67638fc4852be687d3b6c088cd6',uuid=44aed187-a202-483c-b6b7-8a12cdda426c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converting VIF {"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.objects.instance [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lazy-loading 'pci_devices' on Instance uuid 44aed187-a202-483c-b6b7-8a12cdda426c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:36:14 user nova-compute[74839]:   <uuid>44aed187-a202-483c-b6b7-8a12cdda426c</uuid>
Nov 18 15:36:14 user nova-compute[74839]:   <name>instance-0000000e</name>
Nov 18 15:36:14 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:36:14 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:36:14 user nova-compute[74839]:   <metadata>
Nov 18 15:36:14 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:36:14 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:name>tempest-VolumesNegativeTest-instance-444746231</nova:name>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:36:14</nova:creationTime>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:36:14 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:36:14 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:owner>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:user uuid="fe71f67638fc4852be687d3b6c088cd6">tempest-VolumesNegativeTest-1084718722-project-member</nova:user>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:project uuid="d8cdb2242cc143049e8596a1137cb6bc">tempest-VolumesNegativeTest-1084718722</nova:project>
Nov 18 15:36:14 user nova-compute[74839]:       </nova:owner>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:36:14 user nova-compute[74839]:       <nova:ports>
Nov 18 15:36:14 user nova-compute[74839]:         <nova:port uuid="0c5ce580-9e2d-4243-81ba-200d07d88b95">
Nov 18 15:36:14 user nova-compute[74839]:           <nova:ip type="fixed" address="192.168.233.46" ipVersion="4"/>
Nov 18 15:36:14 user nova-compute[74839]:         </nova:port>
Nov 18 15:36:14 user nova-compute[74839]:       </nova:ports>
Nov 18 15:36:14 user nova-compute[74839]:     </nova:instance>
Nov 18 15:36:14 user nova-compute[74839]:   </metadata>
Nov 18 15:36:14 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:36:14 user nova-compute[74839]:     <system>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="serial">44aed187-a202-483c-b6b7-8a12cdda426c</entry>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="uuid">44aed187-a202-483c-b6b7-8a12cdda426c</entry>
Nov 18 15:36:14 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:36:14 user nova-compute[74839]:     </system>
Nov 18 15:36:14 user nova-compute[74839]:   </sysinfo>
Nov 18 15:36:14 user nova-compute[74839]:   <os>
Nov 18 15:36:14 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:36:14 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:36:14 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:36:14 user nova-compute[74839]:   </os>
Nov 18 15:36:14 user nova-compute[74839]:   <features>
Nov 18 15:36:14 user nova-compute[74839]:     <acpi/>
Nov 18 15:36:14 user nova-compute[74839]:     <apic/>
Nov 18 15:36:14 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:36:14 user nova-compute[74839]:   </features>
Nov 18 15:36:14 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:36:14 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:36:14 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:36:14 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:36:14 user nova-compute[74839]:   </clock>
Nov 18 15:36:14 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:36:14 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:36:14 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:36:14 user nova-compute[74839]:   </cpu>
Nov 18 15:36:14 user nova-compute[74839]:   <devices>
Nov 18 15:36:14 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:36:14 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:36:14 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk"/>
Nov 18 15:36:14 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:36:14 user nova-compute[74839]:     </disk>
Nov 18 15:36:14 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:36:14 user nova-compute[74839]:       <mac address="fa:16:3e:81:c0:66"/>
Nov 18 15:36:14 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:14 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:36:14 user nova-compute[74839]:       <target dev="tap0c5ce580-9e"/>
Nov 18 15:36:14 user nova-compute[74839]:     </interface>
Nov 18 15:36:14 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:36:14 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/console.log" append="off"/>
Nov 18 15:36:14 user nova-compute[74839]:     </serial>
Nov 18 15:36:14 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:36:14 user nova-compute[74839]:     <video>
Nov 18 15:36:14 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:14 user nova-compute[74839]:     </video>
Nov 18 15:36:14 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:36:14 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:36:14 user nova-compute[74839]:     </rng>
Nov 18 15:36:14 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:36:14 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:36:14 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:36:14 user nova-compute[74839]:     </memballoon>
Nov 18 15:36:14 user nova-compute[74839]:   </devices>
Nov 18 15:36:14 user nova-compute[74839]: </domain>
Nov 18 15:36:14 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-444746231',display_name='tempest-VolumesNegativeTest-instance-444746231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-444746231',id=14,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8cdb2242cc143049e8596a1137cb6bc',ramdisk_id='',reservation_id='r-e1liqf60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1084718722',owner_user_name='tempest-VolumesNegativeTest-1084718722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:12Z,user_data=None,user_id='fe71f67638fc4852be687d3b6c088cd6',uuid=44aed187-a202-483c-b6b7-8a12cdda426c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converting VIF {"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG os_vif [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fd719fe-d86c-5143-a727-0163a9c1af87', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5ce580-9e, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5ce580-9e, col_values=(('qos', UUID('85e5ffbd-0b9a-444e-8830-ada863458456')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5ce580-9e, col_values=(('external_ids', {'iface-id': '0c5ce580-9e2d-4243-81ba-200d07d88b95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:c0:66', 'vm-uuid': '44aed187-a202-483c-b6b7-8a12cdda426c'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:14 user nova-compute[74839]: INFO os_vif [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e')
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] No VIF found with MAC fa:16:3e:81:c0:66, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Updated VIF entry in instance network info cache for port 0c5ce580-9e2d-4243-81ba-200d07d88b95. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:36:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Updating instance_info_cache with network_info: [{"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e86d315a-6d9f-4e28-af1c-b45b6531e709 req-659a4c1b-3d8a-44df-a934-e14d2e7bcf9e service nova] Releasing lock "refresh_cache-44aed187-a202-483c-b6b7-8a12cdda426c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:36:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Instance spawned successfully.
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:18 user nova-compute[74839]: INFO nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 18 15:36:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:36:18 user nova-compute[74839]: INFO nova.compute.manager [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Took 7.12 seconds to build instance.
Nov 18 15:36:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5127429f-cea3-4030-8f30-bde03c3c95cc tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.226s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] No waiting events found dispatching network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:21 user nova-compute[74839]: WARNING nova.compute.manager [req-a58e046d-f674-4f6c-80ec-51440f864358 req-a67f3f57-24f5-4a86-8451-172e3baadddc service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received unexpected event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 for instance with vm_state active and task_state None.
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:36:23 user nova-compute[74839]: INFO nova.compute.claims [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Claim successful on node user
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] No waiting events found dispatching network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:23 user nova-compute[74839]: WARNING nova.compute.manager [req-a9cae6a4-c9b6-4e7b-a664-39fb873a9e86 req-a68c3d63-97ab-4314-873d-1affcff7886a service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received unexpected event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 for instance with vm_state active and task_state None.
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:23 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:36:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:36:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Creating image(s)
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "5d0dfd378c351d623b8797887842355fab84d343" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "5d0dfd378c351d623b8797887842355fab84d343" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG nova.policy [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '253c9dda2d7349dc9b31386d35076d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d9910968064dfd85bc4d7652da9efc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.part --force-share --output=json" returned: 0 in 0.622s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG nova.virt.images [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] bc13b140-07e4-4248-af85-3e206f45926e was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.part /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:25 user nova-compute[74839]: INFO nova.compute.manager [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Rescuing
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.part /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.converted" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "5d0dfd378c351d623b8797887842355fab84d343" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.546s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "5d0dfd378c351d623b8797887842355fab84d343" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "5d0dfd378c351d623b8797887842355fab84d343" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Successfully created port: 562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343,backing_fmt=raw /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343,backing_fmt=raw /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk 1073741824" returned: 0 in 0.047s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "5d0dfd378c351d623b8797887842355fab84d343" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 --force-share --output=json" returned: 0 in 0.207s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Cannot resize image /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Ensure instance console log exists: /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:26 user nova-compute[74839]: WARNING nova.compute.manager [req-3d9175d8-416d-4aad-a301-e4bc72aec7a2 req-2e5fc0df-eab2-447f-ae0b-19f99916b7a2 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state rescuing.
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Successfully updated port: 562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquired lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-changed-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Refreshing instance network info cache due to event network-changed-562cd7d9-7d92-4e2d-9ef0-0c195bd20131. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] Acquiring lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:36:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updating instance_info_cache with network_info: [{"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Releasing lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Instance network_info: |[{"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] Acquired lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Refreshing network info cache for port 562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Start _get_guest_xml network_info=[{"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:36:18Z,direct_url=<?>,disk_format='qcow2',id=bc13b140-07e4-4248-af85-3e206f45926e,min_disk=0,min_ram=0,name='',owner='4205549b362146bcb604efd0042913b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:36:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'boot_index': 0, 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'bc13b140-07e4-4248-af85-3e206f45926e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:36:27 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:27 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:36:18Z,direct_url=<?>,disk_format='qcow2',id=bc13b140-07e4-4248-af85-3e206f45926e,min_disk=0,min_ram=0,name='',owner='4205549b362146bcb604efd0042913b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:36:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-792549843',display_name='tempest-AttachSCSIVolumeTestJSON-server-792549843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-792549843',id=15,image_ref='bc13b140-07e4-4248-af85-3e206f45926e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4dUNdR1pehlaWR+1TxwTTPqCMi12qDqgDWHFfxzT+Q2kr3qi1XC1O4WC2mU4h5XO89fOiJFp+O5YiXQpN38UIUwQvPfxYiPG7F1z1v5NIDm1bts0ApgMvEsgFkaNYKSw==',key_name='tempest-keypair-1046715440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d9910968064dfd85bc4d7652da9efc',ramdisk_id='',reservation_id='r-e8621smk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc13b140-07e4-4248-af85-3e206f45926e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74390954',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74390954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='253c9dda2d7349dc9b31386d35076d54',uuid=96e7f6d0-b135-4af1-b743-6fd29c1e0080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converting VIF {"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.objects.instance [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lazy-loading 'pci_devices' on Instance uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:36:27 user nova-compute[74839]:   <uuid>96e7f6d0-b135-4af1-b743-6fd29c1e0080</uuid>
Nov 18 15:36:27 user nova-compute[74839]:   <name>instance-0000000f</name>
Nov 18 15:36:27 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:36:27 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:36:27 user nova-compute[74839]:   <metadata>
Nov 18 15:36:27 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:36:27 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-792549843</nova:name>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:36:27</nova:creationTime>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:36:27 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:36:27 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:owner>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:user uuid="253c9dda2d7349dc9b31386d35076d54">tempest-AttachSCSIVolumeTestJSON-74390954-project-member</nova:user>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:project uuid="46d9910968064dfd85bc4d7652da9efc">tempest-AttachSCSIVolumeTestJSON-74390954</nova:project>
Nov 18 15:36:27 user nova-compute[74839]:       </nova:owner>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:root type="image" uuid="bc13b140-07e4-4248-af85-3e206f45926e"/>
Nov 18 15:36:27 user nova-compute[74839]:       <nova:ports>
Nov 18 15:36:27 user nova-compute[74839]:         <nova:port uuid="562cd7d9-7d92-4e2d-9ef0-0c195bd20131">
Nov 18 15:36:27 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 15:36:27 user nova-compute[74839]:         </nova:port>
Nov 18 15:36:27 user nova-compute[74839]:       </nova:ports>
Nov 18 15:36:27 user nova-compute[74839]:     </nova:instance>
Nov 18 15:36:27 user nova-compute[74839]:   </metadata>
Nov 18 15:36:27 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:36:27 user nova-compute[74839]:     <system>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="serial">96e7f6d0-b135-4af1-b743-6fd29c1e0080</entry>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="uuid">96e7f6d0-b135-4af1-b743-6fd29c1e0080</entry>
Nov 18 15:36:27 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:36:27 user nova-compute[74839]:     </system>
Nov 18 15:36:27 user nova-compute[74839]:   </sysinfo>
Nov 18 15:36:27 user nova-compute[74839]:   <os>
Nov 18 15:36:27 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:36:27 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:36:27 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:36:27 user nova-compute[74839]:   </os>
Nov 18 15:36:27 user nova-compute[74839]:   <features>
Nov 18 15:36:27 user nova-compute[74839]:     <acpi/>
Nov 18 15:36:27 user nova-compute[74839]:     <apic/>
Nov 18 15:36:27 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:36:27 user nova-compute[74839]:   </features>
Nov 18 15:36:27 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:36:27 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:36:27 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:36:27 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:36:27 user nova-compute[74839]:   </clock>
Nov 18 15:36:27 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:36:27 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:36:27 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:36:27 user nova-compute[74839]:   </cpu>
Nov 18 15:36:27 user nova-compute[74839]:   <devices>
Nov 18 15:36:27 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:36:27 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:36:27 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk"/>
Nov 18 15:36:27 user nova-compute[74839]:       <target dev="sda" bus="scsi"/>
Nov 18 15:36:27 user nova-compute[74839]:       <address type="drive" controller="0" unit="0"/>
Nov 18 15:36:27 user nova-compute[74839]:     </disk>
Nov 18 15:36:27 user nova-compute[74839]:     <disk type="file" device="cdrom">
Nov 18 15:36:27 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none"/>
Nov 18 15:36:27 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.config"/>
Nov 18 15:36:27 user nova-compute[74839]:       <target dev="sdb" bus="scsi"/>
Nov 18 15:36:27 user nova-compute[74839]:       <address type="drive" controller="0" unit="1"/>
Nov 18 15:36:27 user nova-compute[74839]:     </disk>
Nov 18 15:36:27 user nova-compute[74839]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 18 15:36:27 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:36:27 user nova-compute[74839]:       <mac address="fa:16:3e:46:ca:ee"/>
Nov 18 15:36:27 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:27 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:36:27 user nova-compute[74839]:       <target dev="tap562cd7d9-7d"/>
Nov 18 15:36:27 user nova-compute[74839]:     </interface>
Nov 18 15:36:27 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:36:27 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/console.log" append="off"/>
Nov 18 15:36:27 user nova-compute[74839]:     </serial>
Nov 18 15:36:27 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:36:27 user nova-compute[74839]:     <video>
Nov 18 15:36:27 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:27 user nova-compute[74839]:     </video>
Nov 18 15:36:27 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:36:27 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:36:27 user nova-compute[74839]:     </rng>
Nov 18 15:36:27 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:36:27 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:36:27 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:36:27 user nova-compute[74839]:     </memballoon>
Nov 18 15:36:27 user nova-compute[74839]:   </devices>
Nov 18 15:36:27 user nova-compute[74839]: </domain>
Nov 18 15:36:27 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-792549843',display_name='tempest-AttachSCSIVolumeTestJSON-server-792549843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-792549843',id=15,image_ref='bc13b140-07e4-4248-af85-3e206f45926e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4dUNdR1pehlaWR+1TxwTTPqCMi12qDqgDWHFfxzT+Q2kr3qi1XC1O4WC2mU4h5XO89fOiJFp+O5YiXQpN38UIUwQvPfxYiPG7F1z1v5NIDm1bts0ApgMvEsgFkaNYKSw==',key_name='tempest-keypair-1046715440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d9910968064dfd85bc4d7652da9efc',ramdisk_id='',reservation_id='r-e8621smk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc13b140-07e4-4248-af85-3e206f45926e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74390954',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74390954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='253c9dda2d7349dc9b31386d35076d54',uuid=96e7f6d0-b135-4af1-b743-6fd29c1e0080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converting VIF {"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG os_vif [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2acffb11-7a17-5df8-ae20-f40d6beba72d', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap562cd7d9-7d, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap562cd7d9-7d, col_values=(('qos', UUID('ada4f355-08d0-4f7a-bf03-a020d2288fd9')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap562cd7d9-7d, col_values=(('external_ids', {'iface-id': '562cd7d9-7d92-4e2d-9ef0-0c195bd20131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:ca:ee', 'vm-uuid': '96e7f6d0-b135-4af1-b743-6fd29c1e0080'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:27 user nova-compute[74839]: INFO os_vif [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d')
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No BDM found with device name sda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No VIF found with MAC fa:16:3e:46:ca:ee, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Using config drive
Nov 18 15:36:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Creating config drive at /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.config
Nov 18 15:36:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptde1kdzo {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updated VIF entry in instance network info cache for port 562cd7d9-7d92-4e2d-9ef0-0c195bd20131. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updating instance_info_cache with network_info: [{"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance destroyed successfully.
Nov 18 15:36:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Attempting a stable device rescue
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptde1kdzo" returned: 0 in 0.072s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0342922-c19c-49a6-a967-156ba9b48c9d req-5e03ae6c-f9d8-4aed-8c11-f65699fc5bfd service nova] Releasing lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:36:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Creating image(s)
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:29 user nova-compute[74839]: WARNING nova.compute.manager [req-fd3c2569-288a-451b-b266-6e4419b7c18a req-ee1f85e3-6950-4eea-8a92-c37ccbf7b2b7 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state rescuing.
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.virt.images [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] cd9941fb-185c-49a7-acf6-3ecc3c25fdd4 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.part /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.part /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.converted" returned: 0 in 0.222s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:29 user nova-compute[74839]: WARNING nova.compute.manager [req-c6cb70c4-34dc-4cef-972d-02e55a84ac93 req-32412541-b59f-4d08-9120-6f71ded81c2a service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state building and task_state spawning.
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.501s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50 --force-share --output=json" returned: 0 in 0.235s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50,backing_fmt=raw /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50,backing_fmt=raw /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue" returned: 0 in 0.092s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "476dc4b6699cd78568d55ce4bd91e5aa4bac6b50" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'migration_context' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start _get_guest_xml network_info=[{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:a1:fa:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cd9941fb-185c-49a7-acf6-3ecc3c25fdd4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '88aa12ab-56d1-4c13-99e3-6d3b9bcf9535', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8', 'attached_at': '', 'detached_at': '', 'volume_id': '99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'serial': '99a8f7cc-e2f9-482a-9bf1-39aceceb4215'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:36:30 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:30 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:36:30 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:36:30 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:36:30 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64fa56e-7ec4-4ad4-b4de-ecc09d38a014]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QauMSdgH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 15:36:30 user nova-compute[74839]: node.name = iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:36:30 user nova-compute[74839]: node.tpgt = -1
Nov 18 15:36:30 user nova-compute[74839]: node.startup = automatic
Nov 18 15:36:30 user nova-compute[74839]: node.leading_login = No
Nov 18 15:36:30 user nova-compute[74839]: iface.iscsi_ifacename = default
Nov 18 15:36:30 user nova-compute[74839]: iface.net_ifacename = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.ipaddress = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.prefix_len = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.hwaddress = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.transport_name = tcp
Nov 18 15:36:30 user nova-compute[74839]: iface.initiatorname = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.vlan_id = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.vlan_priority = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.vlan_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.iface_num = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.mtu = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.port = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.bootproto = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.subnet_mask = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.gateway = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_alt_client_id = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_dns = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_learn_iqn = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_vendor_id_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_vendor_id = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.dhcp_slp_da = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.fragmentation = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.gratuitous_arp = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.incoming_forwarding = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.tos_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.tos = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.ttl = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.delayed_ack = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.tcp_nagle = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.tcp_wsf_state = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.tcp_wsf = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.tcp_timer_scale = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.tcp_timestamp = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.redirect = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.def_task_mgmt_timeout = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.header_digest = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.data_digest = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.immediate_data = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.initial_r2t = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.data_seq_inorder = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.data_pdu_inorder = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.erl = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.max_receive_data_len = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.first_burst_len = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.max_outstanding_r2t = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.max_burst_len = 0
Nov 18 15:36:30 user nova-compute[74839]: iface.chap_auth = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.bidi_chap = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.strict_login_compliance = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.discovery_auth = <empty>
Nov 18 15:36:30 user nova-compute[74839]: iface.discovery_logout = <empty>
Nov 18 15:36:30 user nova-compute[74839]: node.discovery_address = <empty>
Nov 18 15:36:30 user nova-compute[74839]: node.discovery_port = 0
Nov 18 15:36:30 user nova-compute[74839]: node.discovery_type = static
Nov 18 15:36:30 user nova-compute[74839]: node.session.initial_cmdsn = 0
Nov 18 15:36:30 user nova-compute[74839]: node.session.initial_login_retry_max = 8
Nov 18 15:36:30 user nova-compute[74839]: node.session.xmit_thread_priority = -20
Nov 18 15:36:30 user nova-compute[74839]: node.session.cmds_max = 128
Nov 18 15:36:30 user nova-compute[74839]: node.session.queue_depth = 32
Nov 18 15:36:30 user nova-compute[74839]: node.session.nr_sessions = 1
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.authmethod = CHAP
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.username = QauMSdgH
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.password = ***
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.username_in = <empty>
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.password_in = <empty>
Nov 18 15:36:30 user nova-compute[74839]: node.session.auth.chap_algs = MD5
Nov 18 15:36:30 user nova-compute[74839]: node.session.timeo.replacement_timeout = 120
Nov 18 15:36:30 user nova-compute[74839]: node.session.err_timeo.abort_timeout = 15
Nov 18 15:36:30 user nova-compute[74839]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 15:36:30 user nova-compute[74839]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 15:36:30 user nova-compute[74839]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.FastAbort = Yes
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.InitialR2T = No
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.ImmediateData = Yes
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.MaxConnections = 1
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 15:36:30 user nova-compute[74839]: node.session.iscsi.ERL = 0
Nov 18 15:36:30 user nova-compute[74839]: node.session.scan = manual
Nov 18 15:36:30 user nova-compute[74839]: node.session.reopen_max = 0
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].address = 172.16.0.220
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].port = 3260
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].startup = manual
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].tcp.window_size = 524288
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].tcp.type_of_service = 0
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].timeo.logout_timeout = 15
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].timeo.login_timeout = 15
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].timeo.auth_timeout = 45
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.DataDigest = None
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.IFMarker = No
Nov 18 15:36:30 user nova-compute[74839]: node.conn[0].iscsi.OFMarker = No
Nov 18 15:36:30 user nova-compute[74839]: # END RECORD
Nov 18 15:36:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6832902b-7149-45c4-9840-339695126d2e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42028f-68e1-4f42-8f44-a41be822e33d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QauMSdgH {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QauMSdgH" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9faeb-7be0-4ccc-b4fa-e864492765bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QauMSdgH'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84005eb2-2d4d-4b9d-b48d-a6b7a7668afc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef76bec-f5cb-4b74-acc2-ebf7ff6ad5bf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:30 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:30 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed3f15-5715-44e3-9655-42771aed6156]: (4, ('0 0 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== connect_volume: return (216ms) {'type': 'block', 'scsi_wwn': '23836383163356265', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836383163356265', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591171237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591171237',id=11,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:34:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-edk04wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:34:53Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:a1:fa:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:a1:fa:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.objects.base [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:36:30 user nova-compute[74839]:   <uuid>2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</uuid>
Nov 18 15:36:30 user nova-compute[74839]:   <name>instance-0000000b</name>
Nov 18 15:36:30 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:36:30 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:36:30 user nova-compute[74839]:   <metadata>
Nov 18 15:36:30 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:36:30 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1591171237</nova:name>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:36:30</nova:creationTime>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:36:30 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:36:30 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:owner>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:36:30 user nova-compute[74839]:       </nova:owner>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:36:30 user nova-compute[74839]:       <nova:ports>
Nov 18 15:36:30 user nova-compute[74839]:         <nova:port uuid="c05a6d87-de9e-4d8a-929c-024bdcdb85b9">
Nov 18 15:36:30 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 15:36:30 user nova-compute[74839]:         </nova:port>
Nov 18 15:36:30 user nova-compute[74839]:       </nova:ports>
Nov 18 15:36:30 user nova-compute[74839]:     </nova:instance>
Nov 18 15:36:30 user nova-compute[74839]:   </metadata>
Nov 18 15:36:30 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:36:30 user nova-compute[74839]:     <system>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="serial">2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</entry>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="uuid">2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8</entry>
Nov 18 15:36:30 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:36:30 user nova-compute[74839]:     </system>
Nov 18 15:36:30 user nova-compute[74839]:   </sysinfo>
Nov 18 15:36:30 user nova-compute[74839]:   <os>
Nov 18 15:36:30 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:36:30 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:36:30 user nova-compute[74839]:   </os>
Nov 18 15:36:30 user nova-compute[74839]:   <features>
Nov 18 15:36:30 user nova-compute[74839]:     <acpi/>
Nov 18 15:36:30 user nova-compute[74839]:     <apic/>
Nov 18 15:36:30 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:36:30 user nova-compute[74839]:   </features>
Nov 18 15:36:30 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:36:30 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:36:30 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:36:30 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:36:30 user nova-compute[74839]:   </clock>
Nov 18 15:36:30 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:36:30 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:36:30 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:36:30 user nova-compute[74839]:   </cpu>
Nov 18 15:36:30 user nova-compute[74839]:   <devices>
Nov 18 15:36:30 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:36:30 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:36:30 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:36:30 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:36:30 user nova-compute[74839]:       <serial>99a8f7cc-e2f9-482a-9bf1-39aceceb4215</serial>
Nov 18 15:36:30 user nova-compute[74839]:     </disk>
Nov 18 15:36:30 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:36:30 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:36:30 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue"/>
Nov 18 15:36:30 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:36:30 user nova-compute[74839]:       <boot order="1"/>
Nov 18 15:36:30 user nova-compute[74839]:     </disk>
Nov 18 15:36:30 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:36:30 user nova-compute[74839]:       <mac address="fa:16:3e:a1:fa:14"/>
Nov 18 15:36:30 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:30 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:36:30 user nova-compute[74839]:       <target dev="tapc05a6d87-de"/>
Nov 18 15:36:30 user nova-compute[74839]:     </interface>
Nov 18 15:36:30 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:36:30 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/console.log" append="off"/>
Nov 18 15:36:30 user nova-compute[74839]:     </serial>
Nov 18 15:36:30 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:36:30 user nova-compute[74839]:     <video>
Nov 18 15:36:30 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:30 user nova-compute[74839]:     </video>
Nov 18 15:36:30 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:36:30 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:36:30 user nova-compute[74839]:     </rng>
Nov 18 15:36:30 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:36:30 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:36:30 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:36:30 user nova-compute[74839]:     </memballoon>
Nov 18 15:36:30 user nova-compute[74839]:   </devices>
Nov 18 15:36:30 user nova-compute[74839]: </domain>
Nov 18 15:36:30 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:36:30 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance destroyed successfully.
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:a1:fa:14, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:31 user nova-compute[74839]: WARNING nova.compute.manager [req-53923eb2-91f2-4f02-8a6a-2fe0d70a5c74 req-fb47432b-f35a-4595-9661-278a85b4069d service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state building and task_state spawning.
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:36:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Instance spawned successfully.
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:32 user nova-compute[74839]: INFO nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Took 7.73 seconds to spawn the instance on the hypervisor.
Nov 18 15:36:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:32 user nova-compute[74839]: INFO nova.compute.manager [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Took 8.61 seconds to build instance.
Nov 18 15:36:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5d0445c8-798a-458b-a303-7511e1c9aef8 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.780s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:32 user nova-compute[74839]: WARNING nova.compute.manager [req-6578fd94-7c29-45ee-8398-f6087ebacf5c req-0dfc9531-7ba3-42a0-863b-11373267ee68 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state rescuing.
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:34 user nova-compute[74839]: WARNING nova.compute.manager [req-53b404cf-9aa1-4ff8-8e27-68f6c367599e req-f0f47c9e-aa39-4349-9d78-2e280b65b5b3 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state rescuing.
Nov 18 15:36:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71cf2318-9fcc-4964-9409-033f6d10b47a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:36:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:36:42 user nova-compute[74839]: INFO nova.compute.claims [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Claim successful on node user
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.840s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Skipping network cache update for instance because it is Building. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:36:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:36:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.policy [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '202cc39d991b49468d4922bddcf93381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a10ded07c8ca4a14ae16a8b2f568572c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:36:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Creating image(s)
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.329s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.224s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-changed-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Refreshing instance network info cache due to event network-changed-42902567-498c-4ab8-94eb-760295084938. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] Acquiring lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] Acquired lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Refreshing network info cache for port 42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk 1073741824" returned: 0 in 0.146s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.239s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Cannot resize image /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Ensure instance console log exists: /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Successfully created port: 471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.network.neutron [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updated VIF entry in instance network info cache for port 42902567-498c-4ab8-94eb-760295084938. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG nova.network.neutron [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating instance_info_cache with network_info: [{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-eb0a6d7c-cb62-40a1-a332-92d2bdaa565c req-261eaefa-f87a-4572-8020-814da4953c5f service nova] Releasing lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Successfully updated port: 471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:46 user nova-compute[74839]: INFO nova.compute.manager [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Terminating instance
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-changed-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Refreshing instance network info cache due to event network-changed-471ecda0-d7f6-4e68-946a-5b7286f0445a. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance network_info: |[{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Refreshing network info cache for port 471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start _get_guest_xml network_info=[{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'pci_devices' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-unplugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] No waiting events found dispatching network-vif-unplugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a11d262-af4a-43fc-a41f-f84b389d530c req-ddf54e1a-2244-430a-a0b3-054d4edf36b7 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-unplugged-9df8a201-048c-4813-a497-60505dd5b01b for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:36:47 user nova-compute[74839]:   <uuid>33c2ac3e-6465-4d42-8cf8-15432abc1b53</uuid>
Nov 18 15:36:47 user nova-compute[74839]:   <name>instance-00000010</name>
Nov 18 15:36:47 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:36:47 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:36:47 user nova-compute[74839]:   <metadata>
Nov 18 15:36:47 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:36:47 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherB-server-419458110</nova:name>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:36:47</nova:creationTime>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:36:47 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:36:47 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:owner>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:user uuid="202cc39d991b49468d4922bddcf93381">tempest-ServerActionsTestOtherB-1220678825-project-member</nova:user>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:project uuid="a10ded07c8ca4a14ae16a8b2f568572c">tempest-ServerActionsTestOtherB-1220678825</nova:project>
Nov 18 15:36:47 user nova-compute[74839]:       </nova:owner>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:36:47 user nova-compute[74839]:       <nova:ports>
Nov 18 15:36:47 user nova-compute[74839]:         <nova:port uuid="471ecda0-d7f6-4e68-946a-5b7286f0445a">
Nov 18 15:36:47 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 15:36:47 user nova-compute[74839]:         </nova:port>
Nov 18 15:36:47 user nova-compute[74839]:       </nova:ports>
Nov 18 15:36:47 user nova-compute[74839]:     </nova:instance>
Nov 18 15:36:47 user nova-compute[74839]:   </metadata>
Nov 18 15:36:47 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:36:47 user nova-compute[74839]:     <system>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="serial">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="uuid">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:36:47 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:36:47 user nova-compute[74839]:     </system>
Nov 18 15:36:47 user nova-compute[74839]:   </sysinfo>
Nov 18 15:36:47 user nova-compute[74839]:   <os>
Nov 18 15:36:47 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:36:47 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:36:47 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:36:47 user nova-compute[74839]:   </os>
Nov 18 15:36:47 user nova-compute[74839]:   <features>
Nov 18 15:36:47 user nova-compute[74839]:     <acpi/>
Nov 18 15:36:47 user nova-compute[74839]:     <apic/>
Nov 18 15:36:47 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:36:47 user nova-compute[74839]:   </features>
Nov 18 15:36:47 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:36:47 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:36:47 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:36:47 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:36:47 user nova-compute[74839]:   </clock>
Nov 18 15:36:47 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:36:47 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:36:47 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:36:47 user nova-compute[74839]:   </cpu>
Nov 18 15:36:47 user nova-compute[74839]:   <devices>
Nov 18 15:36:47 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:36:47 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:36:47 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk"/>
Nov 18 15:36:47 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:36:47 user nova-compute[74839]:     </disk>
Nov 18 15:36:47 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:36:47 user nova-compute[74839]:       <mac address="fa:16:3e:6f:dd:da"/>
Nov 18 15:36:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:47 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:36:47 user nova-compute[74839]:       <target dev="tap471ecda0-d7"/>
Nov 18 15:36:47 user nova-compute[74839]:     </interface>
Nov 18 15:36:47 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:36:47 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/console.log" append="off"/>
Nov 18 15:36:47 user nova-compute[74839]:     </serial>
Nov 18 15:36:47 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:36:47 user nova-compute[74839]:     <video>
Nov 18 15:36:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:47 user nova-compute[74839]:     </video>
Nov 18 15:36:47 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:36:47 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:36:47 user nova-compute[74839]:     </rng>
Nov 18 15:36:47 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:36:47 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:36:47 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:36:47 user nova-compute[74839]:     </memballoon>
Nov 18 15:36:47 user nova-compute[74839]:   </devices>
Nov 18 15:36:47 user nova-compute[74839]: </domain>
Nov 18 15:36:47 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG os_vif [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69c742f1-0607-5744-96f4-3a6b414d439e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471ecda0-d7, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap471ecda0-d7, col_values=(('qos', UUID('c2a366a2-46ff-444f-a2c1-bd6699c82ad6')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap471ecda0-d7, col_values=(('external_ids', {'iface-id': '471ecda0-d7f6-4e68-946a-5b7286f0445a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:dd:da', 'vm-uuid': '33c2ac3e-6465-4d42-8cf8-15432abc1b53'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: INFO os_vif [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No VIF found with MAC fa:16:3e:6f:dd:da, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Instance destroyed successfully.
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'resources' on Instance uuid 0006df13-2c31-4fac-8c3c-f24446ad333d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-388930685',display_name='tempest-VolumesAdminNegativeTest-server-388930685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-388930685',id=12,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:34:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-4al61zuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:34:55Z,user_data=None,user_id='162cc08b925a423caa2f868e93dffdee',uuid=0006df13-2c31-4fac-8c3c-f24446ad333d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "9df8a201-048c-4813-a497-60505dd5b01b", "address": "fa:16:3e:55:1b:a1", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9df8a201-04", "ovs_interfaceid": "9df8a201-048c-4813-a497-60505dd5b01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG os_vif [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9df8a201-04, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=270714f7-7d3e-4354-b46a-f85857fc4475) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:47 user nova-compute[74839]: INFO os_vif [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:a1,bridge_name='br-int',has_traffic_filtering=True,id=9df8a201-048c-4813-a497-60505dd5b01b,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9df8a201-04')
Nov 18 15:36:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Deleting instance files /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d_del
Nov 18 15:36:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Deletion of /opt/stack/data/nova/instances/0006df13-2c31-4fac-8c3c-f24446ad333d_del complete
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updated VIF entry in instance network info cache for port 471ecda0-d7f6-4e68-946a-5b7286f0445a. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63ead163-f421-4d3d-9946-501f33ae0c57 req-7510d75c-d673-4e34-b9bf-a9a3ced06ced service nova] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:48 user nova-compute[74839]: INFO nova.compute.manager [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:48 user nova-compute[74839]: INFO nova.compute.manager [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Attaching volume bd9bfc9d-1756-4a67-b03e-a82b8040445e to /dev/vdb
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.utils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810402a-cf63-4dfc-91d2-6461c8c486b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be74244-3ecd-4d3a-ae54-e5f4c98c34bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc23a6d-c715-4c23-b8c7-0e63c220fcc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0330bc5c-eb18-4129-a1df-15bdd6c48102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:36:48 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85778928-330b-4ded-9ff8-b2108d0a5750]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG os_brick.utils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating existing volume attachment record: 134c8593-028d-4bf6-91d2-08f17475b1dc {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:48 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Took 0.68 seconds to deallocate network for instance.
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-e7666cea-fe57-4959-b71b-0bad4c6f87ab req-28846cd4-b67f-4358-b6ab-2f15bf3e7aa4 service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-deleted-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:49 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '0006df13-2c31-4fac-8c3c-f24446ad333d' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '0006df13-2c31-4fac-8c3c-f24446ad333d' (instance-0000000c)
Nov 18 15:36:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:52 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Deleted allocations for instance 0006df13-2c31-4fac-8c3c-f24446ad333d
Nov 18 15:36:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] Acquiring lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] No waiting events found dispatching network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:52 user nova-compute[74839]: WARNING nova.compute.manager [req-36ec2eea-1118-4b98-bcf2-24376aa66db8 req-a210f2b5-5b30-4107-9d30-e1dc5f59affd service nova] [instance: 0006df13-2c31-4fac-8c3c-f24446ad333d] Received unexpected event network-vif-plugged-9df8a201-048c-4813-a497-60505dd5b01b for instance with vm_state deleted and task_state None.
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:52 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:52 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7858MB free_disk=25.43655776977539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance spawned successfully.
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:52 user nova-compute[74839]: INFO nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Took 8.39 seconds to spawn the instance on the hypervisor.
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c3fdda4-b240-45b2-890a-0ca6a8653e56 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "0006df13-2c31-4fac-8c3c-f24446ad333d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.733s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a1d1e64c-f034-487e-afe0-c67155ba2984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 21d73872-2b83-48b1-b465-9309a293ad81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 44aed187-a202-483c-b6b7-8a12cdda426c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:36:52 user nova-compute[74839]: INFO nova.compute.manager [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Took 9.91 seconds to build instance.
Nov 18 15:36:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-821425f9-0b9b-4a84-ab17-4d198094a7d0 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.045s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:52 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.447s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:36:53 user nova-compute[74839]: INFO nova.compute.claims [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Claim successful on node user
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:53 user nova-compute[74839]: WARNING nova.compute.manager [req-4e4ed209-4e29-414f-8b08-1c7d0ba42039 req-9cc542c9-fad2-4beb-b5d7-041699565512 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state None.
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:36:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.policy [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5789c3f8f97b4d58871c77cdd19b969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572badc0c30b4e3ba5b41b49cb2f8ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:36:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Creating image(s)
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "/opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.238s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk 1073741824" returned: 0 in 0.074s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Successfully created port: c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Cannot resize image /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Ensure instance console log exists: /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Successfully updated port: c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing instance network info cache due to event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Instance network_info: |[{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Start _get_guest_xml network_info=[{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:36:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006690769',display_name='tempest-ServerActionsTestOtherA-server-2006690769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006690769',id=17,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-hzvj61et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=df4b8778-e410-4771-99f8-eefb3aeb39d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.objects.instance [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'pci_devices' on Instance uuid df4b8778-e410-4771-99f8-eefb3aeb39d2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:55 user nova-compute[74839]: WARNING nova.compute.manager [req-9a8920f3-fbc2-4924-af18-e1bea1005a74 req-4fb7da24-8a8d-43e4-9709-8d6354b4f3d0 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state None.
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:36:55 user nova-compute[74839]:   <uuid>df4b8778-e410-4771-99f8-eefb3aeb39d2</uuid>
Nov 18 15:36:55 user nova-compute[74839]:   <name>instance-00000011</name>
Nov 18 15:36:55 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:36:55 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:36:55 user nova-compute[74839]:   <metadata>
Nov 18 15:36:55 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:36:55 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherA-server-2006690769</nova:name>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:36:55</nova:creationTime>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:36:55 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:36:55 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:owner>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:user uuid="5789c3f8f97b4d58871c77cdd19b969a">tempest-ServerActionsTestOtherA-89343349-project-member</nova:user>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:project uuid="572badc0c30b4e3ba5b41b49cb2f8ed6">tempest-ServerActionsTestOtherA-89343349</nova:project>
Nov 18 15:36:55 user nova-compute[74839]:       </nova:owner>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:36:55 user nova-compute[74839]:       <nova:ports>
Nov 18 15:36:55 user nova-compute[74839]:         <nova:port uuid="c799ed01-94bb-47bd-85a4-36f181a215ba">
Nov 18 15:36:55 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:36:55 user nova-compute[74839]:         </nova:port>
Nov 18 15:36:55 user nova-compute[74839]:       </nova:ports>
Nov 18 15:36:55 user nova-compute[74839]:     </nova:instance>
Nov 18 15:36:55 user nova-compute[74839]:   </metadata>
Nov 18 15:36:55 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:36:55 user nova-compute[74839]:     <system>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="serial">df4b8778-e410-4771-99f8-eefb3aeb39d2</entry>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="uuid">df4b8778-e410-4771-99f8-eefb3aeb39d2</entry>
Nov 18 15:36:55 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:36:55 user nova-compute[74839]:     </system>
Nov 18 15:36:55 user nova-compute[74839]:   </sysinfo>
Nov 18 15:36:55 user nova-compute[74839]:   <os>
Nov 18 15:36:55 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:36:55 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:36:55 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:36:55 user nova-compute[74839]:   </os>
Nov 18 15:36:55 user nova-compute[74839]:   <features>
Nov 18 15:36:55 user nova-compute[74839]:     <acpi/>
Nov 18 15:36:55 user nova-compute[74839]:     <apic/>
Nov 18 15:36:55 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:36:55 user nova-compute[74839]:   </features>
Nov 18 15:36:55 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:36:55 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:36:55 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:36:55 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:36:55 user nova-compute[74839]:   </clock>
Nov 18 15:36:55 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:36:55 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:36:55 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:36:55 user nova-compute[74839]:   </cpu>
Nov 18 15:36:55 user nova-compute[74839]:   <devices>
Nov 18 15:36:55 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:36:55 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:36:55 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk"/>
Nov 18 15:36:55 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:36:55 user nova-compute[74839]:     </disk>
Nov 18 15:36:55 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:36:55 user nova-compute[74839]:       <mac address="fa:16:3e:3a:df:43"/>
Nov 18 15:36:55 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:55 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:36:55 user nova-compute[74839]:       <target dev="tapc799ed01-94"/>
Nov 18 15:36:55 user nova-compute[74839]:     </interface>
Nov 18 15:36:55 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:36:55 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/console.log" append="off"/>
Nov 18 15:36:55 user nova-compute[74839]:     </serial>
Nov 18 15:36:55 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:36:55 user nova-compute[74839]:     <video>
Nov 18 15:36:55 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:36:55 user nova-compute[74839]:     </video>
Nov 18 15:36:55 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:36:55 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:36:55 user nova-compute[74839]:     </rng>
Nov 18 15:36:55 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:36:55 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:36:55 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:36:55 user nova-compute[74839]:     </memballoon>
Nov 18 15:36:55 user nova-compute[74839]:   </devices>
Nov 18 15:36:55 user nova-compute[74839]: </domain>
Nov 18 15:36:55 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006690769',display_name='tempest-ServerActionsTestOtherA-server-2006690769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006690769',id=17,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-hzvj61et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:36:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=df4b8778-e410-4771-99f8-eefb3aeb39d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG os_vif [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6468d1ef-c284-5b35-9734-85d90ac97f4f', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc799ed01-94, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc799ed01-94, col_values=(('qos', UUID('76eedb55-0280-40f2-af7d-cdaa862cd65a')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc799ed01-94, col_values=(('external_ids', {'iface-id': 'c799ed01-94bb-47bd-85a4-36f181a215ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:df:43', 'vm-uuid': 'df4b8778-e410-4771-99f8-eefb3aeb39d2'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:55 user nova-compute[74839]: INFO os_vif [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94')
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:3a:df:43, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updated VIF entry in instance network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:36:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-da037acd-074e-41dc-a6f0-9298db3ea390 req-2cd08b23-727f-4aaa-9877-10d6b0840824 service nova] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksxutNYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:36:56 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:36:56 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:36:56 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4076ce-e4b4-4984-a21b-e2af14b75905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:36:56 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11e537-8907-4af8-a59b-918691763cb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e] added
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb0a10-9b20-4b50-bbc5-90062a4adb17]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7d09e-792b-4778-84db-328075f19d3d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksxutNYB {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksxutNYB" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[410fda8b-8b42-49bd-b07b-58b31bb0e10a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksxutNYB'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698326a-2b87-4572-a0ba-91474dcfef41]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea1e797-2394-40e0-85a6-965cefaae8d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef18f3-17b4-4ffd-b86e-68a81855a151]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260]
Nov 18 15:36:56 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260] successful.
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc3053-66ac-4a63-8e74-4b7c932016de]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19730124-f544-4de7-8fa4-c6163234eefe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:36:56 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:36:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.035s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699bc97-3feb-4980-8b56-0f30960d8d3c]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksxutNYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] No waiting events found dispatching network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:57 user nova-compute[74839]: WARNING nova.compute.manager [req-4df7a8e1-489b-4866-bdbc-8ca95384ef11 req-b70c2e29-c8c4-4afa-9ad3-65d23ba3a1b4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received unexpected event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba for instance with vm_state building and task_state spawning.
Nov 18 15:36:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26664646437636265', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664646437636265', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:36:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:36:57 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:36:57 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:36:57 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:36:57 user nova-compute[74839]:   <serial>bd9bfc9d-1756-4a67-b03e-a82b8040445e</serial>
Nov 18 15:36:57 user nova-compute[74839]: </disk>
Nov 18 15:36:57 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:36:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:36:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:ab:ce:0f, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:36:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39980073-3784-4477-837a-4d200a87900e tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.353s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] No waiting events found dispatching network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:36:59 user nova-compute[74839]: WARNING nova.compute.manager [req-844f9bde-6a62-4fd1-b8d0-15160bb1d4f3 req-675f3b3b-9bfa-419c-8e98-d1b8f2057d36 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received unexpected event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba for instance with vm_state building and task_state spawning.
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:36:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Instance spawned successfully.
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:36:59 user nova-compute[74839]: INFO nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 18 15:36:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:36:59 user nova-compute[74839]: INFO nova.compute.manager [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Took 7.10 seconds to build instance.
Nov 18 15:36:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-952fe4b4-c351-4661-be30-003fd41c8cd1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.263s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:36:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:01 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:37:01 user nova-compute[74839]: INFO nova.compute.claims [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Claim successful on node user
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:37:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.policy [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd5091855f2647abba05a98492302656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67202285b746fb80c72ae0d42394d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:37:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Creating image(s)
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "/opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk 1073741824" returned: 0 in 0.052s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Successfully created port: 8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Cannot resize image /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Ensure instance console log exists: /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Successfully updated port: 8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquired lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-changed-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Refreshing instance network info cache due to event network-changed-8063c375-a435-4adb-a8c7-46a1fce9e1a6. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] Acquiring lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:37:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updating instance_info_cache with network_info: [{"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Releasing lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Instance network_info: |[{"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] Acquired lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Refreshing network info cache for port 8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Start _get_guest_xml network_info=[{"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:37:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:37:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636770282',display_name='tempest-AttachVolumeNegativeTest-server-636770282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636770282',id=18,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFlUG4eXkyPo44dowG+Yl7SIHpt7HKK5NslDeHM7MmQmpVP3E2DoS15sFzkkp/qpQ+5vzSZA6Qehp97QnAKuckRJ95kRZAUJgCo27056dqKr4/ZeGDcRsHAHQliY4cNCw==',key_name='tempest-keypair-131297420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-gqy8aawj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=45f90ba6-194c-498c-bcfd-e43d0c8fa261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'pci_devices' on Instance uuid 45f90ba6-194c-498c-bcfd-e43d0c8fa261 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:37:04 user nova-compute[74839]:   <uuid>45f90ba6-194c-498c-bcfd-e43d0c8fa261</uuid>
Nov 18 15:37:04 user nova-compute[74839]:   <name>instance-00000012</name>
Nov 18 15:37:04 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:37:04 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:37:04 user nova-compute[74839]:   <metadata>
Nov 18 15:37:04 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:37:04 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeNegativeTest-server-636770282</nova:name>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:37:04</nova:creationTime>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:37:04 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:37:04 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:owner>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:user uuid="fd5091855f2647abba05a98492302656">tempest-AttachVolumeNegativeTest-183955382-project-member</nova:user>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:project uuid="9d67202285b746fb80c72ae0d42394d5">tempest-AttachVolumeNegativeTest-183955382</nova:project>
Nov 18 15:37:04 user nova-compute[74839]:       </nova:owner>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:37:04 user nova-compute[74839]:       <nova:ports>
Nov 18 15:37:04 user nova-compute[74839]:         <nova:port uuid="8063c375-a435-4adb-a8c7-46a1fce9e1a6">
Nov 18 15:37:04 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 15:37:04 user nova-compute[74839]:         </nova:port>
Nov 18 15:37:04 user nova-compute[74839]:       </nova:ports>
Nov 18 15:37:04 user nova-compute[74839]:     </nova:instance>
Nov 18 15:37:04 user nova-compute[74839]:   </metadata>
Nov 18 15:37:04 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:37:04 user nova-compute[74839]:     <system>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="serial">45f90ba6-194c-498c-bcfd-e43d0c8fa261</entry>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="uuid">45f90ba6-194c-498c-bcfd-e43d0c8fa261</entry>
Nov 18 15:37:04 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:37:04 user nova-compute[74839]:     </system>
Nov 18 15:37:04 user nova-compute[74839]:   </sysinfo>
Nov 18 15:37:04 user nova-compute[74839]:   <os>
Nov 18 15:37:04 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:37:04 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:37:04 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:37:04 user nova-compute[74839]:   </os>
Nov 18 15:37:04 user nova-compute[74839]:   <features>
Nov 18 15:37:04 user nova-compute[74839]:     <acpi/>
Nov 18 15:37:04 user nova-compute[74839]:     <apic/>
Nov 18 15:37:04 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:37:04 user nova-compute[74839]:   </features>
Nov 18 15:37:04 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:37:04 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:37:04 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:37:04 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:37:04 user nova-compute[74839]:   </clock>
Nov 18 15:37:04 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:37:04 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:37:04 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:37:04 user nova-compute[74839]:   </cpu>
Nov 18 15:37:04 user nova-compute[74839]:   <devices>
Nov 18 15:37:04 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:37:04 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:37:04 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk"/>
Nov 18 15:37:04 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:37:04 user nova-compute[74839]:     </disk>
Nov 18 15:37:04 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:37:04 user nova-compute[74839]:       <mac address="fa:16:3e:cc:39:d0"/>
Nov 18 15:37:04 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:37:04 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:37:04 user nova-compute[74839]:       <target dev="tap8063c375-a4"/>
Nov 18 15:37:04 user nova-compute[74839]:     </interface>
Nov 18 15:37:04 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:37:04 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/console.log" append="off"/>
Nov 18 15:37:04 user nova-compute[74839]:     </serial>
Nov 18 15:37:04 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:37:04 user nova-compute[74839]:     <video>
Nov 18 15:37:04 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:37:04 user nova-compute[74839]:     </video>
Nov 18 15:37:04 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:37:04 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:37:04 user nova-compute[74839]:     </rng>
Nov 18 15:37:04 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:37:04 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:37:04 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:37:04 user nova-compute[74839]:     </memballoon>
Nov 18 15:37:04 user nova-compute[74839]:   </devices>
Nov 18 15:37:04 user nova-compute[74839]: </domain>
Nov 18 15:37:04 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636770282',display_name='tempest-AttachVolumeNegativeTest-server-636770282',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636770282',id=18,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFlUG4eXkyPo44dowG+Yl7SIHpt7HKK5NslDeHM7MmQmpVP3E2DoS15sFzkkp/qpQ+5vzSZA6Qehp97QnAKuckRJ95kRZAUJgCo27056dqKr4/ZeGDcRsHAHQliY4cNCw==',key_name='tempest-keypair-131297420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-gqy8aawj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=45f90ba6-194c-498c-bcfd-e43d0c8fa261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG os_vif [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ca80b3e-5cb4-5277-91cc-eb1693125e1c', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8063c375-a4, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8063c375-a4, col_values=(('qos', UUID('2cb27196-ce05-40a2-a2ec-120ca0773307')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8063c375-a4, col_values=(('external_ids', {'iface-id': '8063c375-a435-4adb-a8c7-46a1fce9e1a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:39:d0', 'vm-uuid': '45f90ba6-194c-498c-bcfd-e43d0c8fa261'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:04 user nova-compute[74839]: INFO os_vif [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4')
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:cc:39:d0, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updated VIF entry in instance network info cache for port 8063c375-a435-4adb-a8c7-46a1fce9e1a6. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updating instance_info_cache with network_info: [{"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b76a5481-1c4b-410f-9ec1-e0d69508772e req-a5023c44-b8f2-4a38-a4ff-642bc840327c service nova] Releasing lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:37:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] No waiting events found dispatching network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:37:05 user nova-compute[74839]: WARNING nova.compute.manager [req-6879322d-3865-408c-9b42-f709e767bb3e req-61d84da9-9896-4d18-ad85-c9334c9ff260 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received unexpected event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 for instance with vm_state building and task_state spawning.
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:37:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Instance spawned successfully.
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] No waiting events found dispatching network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:37:07 user nova-compute[74839]: WARNING nova.compute.manager [req-4671db50-5025-4fc0-99ab-89efe9e6f22c req-24d5762e-cb07-4bc7-b06f-b959092f4403 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received unexpected event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 for instance with vm_state building and task_state spawning.
Nov 18 15:37:07 user nova-compute[74839]: INFO nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 18 15:37:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:37:08 user nova-compute[74839]: INFO nova.compute.manager [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Took 6.36 seconds to build instance.
Nov 18 15:37:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d1244af7-915b-44a9-813d-a883ce67a649 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:20 user nova-compute[74839]: INFO nova.compute.manager [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Detaching volume 6a7ef761-4f88-4609-9d83-61468920bd8d
Nov 18 15:37:20 user nova-compute[74839]: INFO nova.virt.block_device [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Attempting to driver detach volume 6a7ef761-4f88-4609-9d83-61468920bd8d from mountpoint /dev/vdc
Nov 18 15:37:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Attempting to detach device vdc from instance 21d73872-2b83-48b1-b465-9309a293ad81 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:37:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:37:20 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:37:20 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:37:20 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 15:37:20 user nova-compute[74839]:   <serial>6a7ef761-4f88-4609-9d83-61468920bd8d</serial>
Nov 18 15:37:20 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 15:37:20 user nova-compute[74839]: </disk>
Nov 18 15:37:20 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:37:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully detached device vdc from instance 21d73872-2b83-48b1-b465-9309a293ad81 from the persistent domain config.
Nov 18 15:37:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 21d73872-2b83-48b1-b465-9309a293ad81 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:37:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:37:20 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:37:20 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:37:20 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 15:37:20 user nova-compute[74839]:   <serial>6a7ef761-4f88-4609-9d83-61468920bd8d</serial>
Nov 18 15:37:20 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 15:37:20 user nova-compute[74839]: </disk>
Nov 18 15:37:20 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:37:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:37:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:37:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:37:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:32 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:34 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [{"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-21d73872-2b83-48b1-b465-9309a293ad81" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:37:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:37 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:37 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:39 user nova-compute[74839]: INFO nova.compute.manager [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Terminating instance
Nov 18 15:37:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-unplugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] No waiting events found dispatching network-vif-unplugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-4b063cb8-c0e6-403f-88c8-a00bbb9362a6 req-457134a4-0dd3-4a2d-a56a-97408bf3426b service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-unplugged-c306b011-a6ed-4eea-985f-1edac8cf46ee for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Instance destroyed successfully.
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lazy-loading 'resources' on Instance uuid 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1706783870',display_name='tempest-VolumesAdminNegativeTest-server-1706783870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1706783870',id=4,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAdzlquspOQZk7Atq243zy6SMfOKK7LGLHQRgwjo+riZqIxnruWA1zLIDP8fbNtzP1GDfx1qlsXV3oPT6b/GR6srFYDGkhia+3JhDmVJwHEz7PMIhjiN2+0As8y+pQVAQ==',key_name='tempest-keypair-947392113',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='262e132ce68d4ff9bfd9e25e9e0dd141',ramdisk_id='',reservation_id='r-e7ycnn43',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-375832265',owner_user_name='tempest-VolumesAdminNegativeTest-375832265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:32:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='162cc08b925a423caa2f868e93dffdee',uuid=2a9f7c8c-3c7a-4325-9738-badd6962d3a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converting VIF {"id": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "address": "fa:16:3e:9b:c3:fb", "network": {"id": "b91316fb-38fc-4ee2-946b-ba93c8f971d9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1975384658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "262e132ce68d4ff9bfd9e25e9e0dd141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc306b011-a6", "ovs_interfaceid": "c306b011-a6ed-4eea-985f-1edac8cf46ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG os_vif [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc306b011-a6, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0802e3af-e707-438b-a448-5b8c78e684d8) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:40 user nova-compute[74839]: INFO os_vif [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c3:fb,bridge_name='br-int',has_traffic_filtering=True,id=c306b011-a6ed-4eea-985f-1edac8cf46ee,network=Network(b91316fb-38fc-4ee2-946b-ba93c8f971d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc306b011-a6')
Nov 18 15:37:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Deleting instance files /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6_del
Nov 18 15:37:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Deletion of /opt/stack/data/nova/instances/2a9f7c8c-3c7a-4325-9738-badd6962d3a6_del complete
Nov 18 15:37:40 user nova-compute[74839]: INFO nova.compute.manager [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 21d73872-2b83-48b1-b465-9309a293ad81 is timed out.
Nov 18 15:37:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully detached device vdc from instance 21d73872-2b83-48b1-b465-9309a293ad81 from the live domain config.
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGgTSIiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:37:41 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec39371-cb5d-4e69-8670-2e9dc383ff74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:37:41 user nova-compute[74839]: No targets found.
Nov 18 15:37:41 user nova-compute[74839]: iSNS:
Nov 18 15:37:41 user nova-compute[74839]: No targets found.
Nov 18 15:37:41 user nova-compute[74839]: STATIC:
Nov 18 15:37:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e
Nov 18 15:37:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:37:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:37:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:37:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:37:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:37:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d
Nov 18 15:37:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:37:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:37:41 user nova-compute[74839]: FIRMWARE:
Nov 18 15:37:41 user nova-compute[74839]: No targets found.
Nov 18 15:37:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:37:41 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:37:41 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1f2d09-3421-4209-b37f-e1c8528bf592]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de571b9-6dbc-47f7-99c9-da9e24db7a13]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:37:41 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:37:41 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:37:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:37:41 user nova-compute[74839]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d (non-flash)
Nov 18 15:37:41 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:37:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480515900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dba54c-3f9e-4135-b536-a6d09f7b1363]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d334ec53-ad90-4ce7-98fb-d85dc26e4eda]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f22ced-e8f0-4e27-977a-4cd4fb0ae9b1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467cff8-3078-4a7c-a0a1-85ef1631c565]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86bcb5a-eca3-4a81-8a27-643944c9d4c3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6302910-138a-42c2-bf3f-9c6199fc12af]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260]
Nov 18 15:37:41 user nova-compute[74839]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d, portal: 172.16.0.220,3260] successful.
Nov 18 15:37:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3760d776-6cfa-4643-8bd9-65f7b42b3401 req-3f178ed3-be33-4c3d-aecd-127ce01c6e01 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-deleted-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:41 user nova-compute[74839]: INFO nova.compute.manager [req-3760d776-6cfa-4643-8bd9-65f7b42b3401 req-3f178ed3-be33-4c3d-aecd-127ce01c6e01 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Neutron deleted interface c306b011-a6ed-4eea-985f-1edac8cf46ee; detaching it from the instance and deleting it from the info cache
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-3760d776-6cfa-4643-8bd9-65f7b42b3401 req-3f178ed3-be33-4c3d-aecd-127ce01c6e01 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a7ef761-4f88-4609-9d83-61468920bd8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba288141-27d9-4a24-8062-b426fa305c5a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:37:41 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Took 0.73 seconds to deallocate network for instance.
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] <== disconnect_volume: return (432ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3760d776-6cfa-4643-8bd9-65f7b42b3401 req-3f178ed3-be33-4c3d-aecd-127ce01c6e01 service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Detach interface failed, port_id=c306b011-a6ed-4eea-985f-1edac8cf46ee, reason: Instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:37:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid '2a9f7c8c-3c7a-4325-9738-badd6962d3a6' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid '2a9f7c8c-3c7a-4325-9738-badd6962d3a6' (instance-00000004)
Nov 18 15:37:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:37:41 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] Acquiring lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] No waiting events found dispatching network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:37:42 user nova-compute[74839]: WARNING nova.compute.manager [req-de72586e-ec05-4aac-83b2-f62939fc401c req-5744f1f1-e04c-43d4-b28c-7de25ce12cff service nova] [instance: 2a9f7c8c-3c7a-4325-9738-badd6962d3a6] Received unexpected event network-vif-plugged-c306b011-a6ed-4eea-985f-1edac8cf46ee for instance with vm_state deleted and task_state None.
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'flavor' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.760s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4a1144f3-c84e-402e-b00c-6553a9583da1 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:42 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Deleted allocations for instance 2a9f7c8c-3c7a-4325-9738-badd6962d3a6
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:37:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8e4b99a9-cb62-4fe8-8ca7-50a0b8e6ea63 tempest-VolumesAdminNegativeTest-375832265 tempest-VolumesAdminNegativeTest-375832265-project-member] Lock "2a9f7c8c-3c7a-4325-9738-badd6962d3a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.755s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:37:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7376MB free_disk=25.34537124633789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a1d1e64c-f034-487e-afe0-c67155ba2984 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 21d73872-2b83-48b1-b465-9309a293ad81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 44aed187-a202-483c-b6b7-8a12cdda426c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 45f90ba6-194c-498c-bcfd-e43d0c8fa261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:37:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 44aed187-a202-483c-b6b7-8a12cdda426c {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid df4b8778-e410-4771-99f8-eefb3aeb39d2 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 45f90ba6-194c-498c-bcfd-e43d0c8fa261 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:37:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:01 user nova-compute[74839]: INFO nova.compute.manager [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Terminating instance
Nov 18 15:38:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-unplugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] No waiting events found dispatching network-vif-unplugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-f588003b-eaa1-4d84-abb2-3d2d883f30e1 req-a24362d9-f4d5-470e-b635-75baa472afa5 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-unplugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:38:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Instance destroyed successfully.
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lazy-loading 'resources' on Instance uuid 44aed187-a202-483c-b6b7-8a12cdda426c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-444746231',display_name='tempest-VolumesNegativeTest-instance-444746231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-444746231',id=14,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8cdb2242cc143049e8596a1137cb6bc',ramdisk_id='',reservation_id='r-e1liqf60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1084718722',owner_user_name='tempest-VolumesNegativeTest-1084718722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:36:19Z,user_data=None,user_id='fe71f67638fc4852be687d3b6c088cd6',uuid=44aed187-a202-483c-b6b7-8a12cdda426c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converting VIF {"id": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "address": "fa:16:3e:81:c0:66", "network": {"id": "c44d4f70-30a0-4508-890a-72902bb47573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "5d8f468b6f7b48838b35fbaec10780a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5ce580-9e", "ovs_interfaceid": "0c5ce580-9e2d-4243-81ba-200d07d88b95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG os_vif [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5ce580-9e, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85e5ffbd-0b9a-444e-8830-ada863458456) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:02 user nova-compute[74839]: INFO os_vif [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=0c5ce580-9e2d-4243-81ba-200d07d88b95,network=Network(c44d4f70-30a0-4508-890a-72902bb47573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5ce580-9e')
Nov 18 15:38:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Deleting instance files /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c_del
Nov 18 15:38:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Deletion of /opt/stack/data/nova/instances/44aed187-a202-483c-b6b7-8a12cdda426c_del complete
Nov 18 15:38:02 user nova-compute[74839]: INFO nova.compute.manager [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 15:38:02 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:38:02 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:03 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Took 0.55 seconds to deallocate network for instance.
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-0078ffef-afa5-42f6-ac69-292fcae173b7 req-9de0e188-f67b-46c1-bf8a-f2b5787b9170 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-deleted-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:03 user nova-compute[74839]: INFO nova.compute.manager [req-0078ffef-afa5-42f6-ac69-292fcae173b7 req-9de0e188-f67b-46c1-bf8a-f2b5787b9170 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Neutron deleted interface 0c5ce580-9e2d-4243-81ba-200d07d88b95; detaching it from the instance and deleting it from the info cache
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.network.neutron [req-0078ffef-afa5-42f6-ac69-292fcae173b7 req-9de0e188-f67b-46c1-bf8a-f2b5787b9170 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-0078ffef-afa5-42f6-ac69-292fcae173b7 req-9de0e188-f67b-46c1-bf8a-f2b5787b9170 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Detach interface failed, port_id=0c5ce580-9e2d-4243-81ba-200d07d88b95, reason: Instance 44aed187-a202-483c-b6b7-8a12cdda426c could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:03 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Deleted allocations for instance 44aed187-a202-483c-b6b7-8a12cdda426c
Nov 18 15:38:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ead6cb0c-4708-4863-a409-56cbf4751e0a tempest-VolumesNegativeTest-1084718722 tempest-VolumesNegativeTest-1084718722-project-member] Lock "44aed187-a202-483c-b6b7-8a12cdda426c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] Acquiring lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] Lock "44aed187-a202-483c-b6b7-8a12cdda426c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] No waiting events found dispatching network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:04 user nova-compute[74839]: WARNING nova.compute.manager [req-7f205b31-9d95-485f-adda-649e3529fbb8 req-d00ae3e4-c09f-480d-b479-eab1a03e9555 service nova] [instance: 44aed187-a202-483c-b6b7-8a12cdda426c] Received unexpected event network-vif-plugged-0c5ce580-9e2d-4243-81ba-200d07d88b95 for instance with vm_state deleted and task_state None.
Nov 18 15:38:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:10 user nova-compute[74839]: INFO nova.compute.manager [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Terminating instance
Nov 18 15:38:10 user nova-compute[74839]: DEBUG nova.compute.manager [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-9494cb0b-bc9a-4f8b-b11b-1876452b5fd6 req-f5151396-bb85-418f-9eb0-a5d58ca49b87 service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-unplugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:38:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Instance destroyed successfully.
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'resources' on Instance uuid 21d73872-2b83-48b1-b465-9309a293ad81 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:31:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368053819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368053819',id=3,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4yYZM8oolwsDs4eJztk8p2sQ0k4YOhUSFERwBo+fGrI5IIzDXx9u4GSboz1eZiv5F+oKNt5j4TNItG3hRprfPwCQd63vgOlTn69ZFk2uQpQp44zgZEeONz9kuC0ckSFw==',key_name='tempest-keypair-494084705',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-8mnr25bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=21d73872-2b83-48b1-b465-9309a293ad81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "426cda54-c5b6-404c-bba7-727c58ec4952", "address": "fa:16:3e:27:06:86", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap426cda54-c5", "ovs_interfaceid": "426cda54-c5b6-404c-bba7-727c58ec4952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG os_vif [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap426cda54-c5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b7f3b32-81b1-43de-bd05-ce51fee5356f) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:38:11 user nova-compute[74839]: INFO os_vif [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:06:86,bridge_name='br-int',has_traffic_filtering=True,id=426cda54-c5b6-404c-bba7-727c58ec4952,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap426cda54-c5')
Nov 18 15:38:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Deleting instance files /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81_del
Nov 18 15:38:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Deletion of /opt/stack/data/nova/instances/21d73872-2b83-48b1-b465-9309a293ad81_del complete
Nov 18 15:38:11 user nova-compute[74839]: INFO nova.compute.manager [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 15:38:11 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:38:11 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:38:12 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:12 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Took 0.77 seconds to deallocate network for instance.
Nov 18 15:38:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:12 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Deleted allocations for instance 21d73872-2b83-48b1-b465-9309a293ad81
Nov 18 15:38:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2562b3ce-23cf-4196-9c32-af13d3dced59 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21d73872-2b83-48b1-b465-9309a293ad81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] Acquiring lock "21d73872-2b83-48b1-b465-9309a293ad81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] Lock "21d73872-2b83-48b1-b465-9309a293ad81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] No waiting events found dispatching network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:13 user nova-compute[74839]: WARNING nova.compute.manager [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received unexpected event network-vif-plugged-426cda54-c5b6-404c-bba7-727c58ec4952 for instance with vm_state deleted and task_state None.
Nov 18 15:38:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ee6e779-4d61-4c4b-a333-60825d960762 req-9f796de2-5790-4e04-b692-94b3450dce1d service nova] [instance: 21d73872-2b83-48b1-b465-9309a293ad81] Received event network-vif-deleted-426cda54-c5b6-404c-bba7-727c58ec4952 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-changed-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Refreshing instance network info cache due to event network-changed-562cd7d9-7d92-4e2d-9ef0-0c195bd20131. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] Acquiring lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] Acquired lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Refreshing network info cache for port 562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updated VIF entry in instance network info cache for port 562cd7d9-7d92-4e2d-9ef0-0c195bd20131. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updating instance_info_cache with network_info: [{"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08321be4-9e17-4321-be02-7556e1db4c96 req-d70a6db0-d416-4769-b300-d229a0be3eb5 service nova] Releasing lock "refresh_cache-96e7f6d0-b135-4af1-b743-6fd29c1e0080" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:16 user nova-compute[74839]: INFO nova.compute.manager [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Unrescuing
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lazy-loading 'flavor' on Instance uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'flavor' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:17 user nova-compute[74839]: INFO nova.compute.manager [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Attaching volume 0256e5af-a0f7-4056-9bcf-93e8b21de449 to /dev/sdc
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.utils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a2028-af90-4405-9257-9a11a9074f2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:17 user nova-compute[74839]: WARNING nova.compute.manager [req-5e81066e-6883-4daa-887c-f0a35f69e214 req-545961bb-ebc7-4737-a93b-1148d31e9bcc service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0aec6c-4127-4b52-82f4-c2fcce11559e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19afa789-0403-4b9e-ba73-c3cc7895a373]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c7c62-0929-40aa-b50c-dc8b1d4627b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:38:17 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:38:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b00808-3e4f-4bdc-a509-8e9912777ecf]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG os_brick.utils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:38:17 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updating existing volume attachment record: 6355f484-e69c-4555-8770-5f37dd86adde {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:38:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance destroyed successfully.
Nov 18 15:38:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:19 user nova-compute[74839]: WARNING nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:38:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:19 user nova-compute[74839]: WARNING nova.compute.manager [req-4faef536-328f-4254-9269-812e98acdf80 req-c6951fe1-a319-46dc-ad03-3c8f10b9676a service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:38:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-eccb425a-dd81-4f69-a8c1-2efb3de5b703 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:21 user nova-compute[74839]: WARNING nova.compute.manager [req-8812258e-8ee9-490f-820b-0f015ae42ce8 req-701304b9-84cd-4710-a240-485ab6dbc234 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state None.
Nov 18 15:38:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGDMANPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:38:22 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:38:22 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:38:22 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4caba-29cc-45c3-bfc7-18c40ecb446f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:38:22 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c7454f-395f-4ff3-b7be-968449b195d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449] added
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b239a6f-49fd-4a7e-9994-519e464cdd0c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500ce7e-5f12-4744-9673-aab9d832e37f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGDMANPf {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGDMANPf" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e547c8-a000-4088-bee3-5b4322a8baa8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGDMANPf'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2433aa75-accb-4056-a5ff-1b601f8bc016]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a0cb1-b83b-4a13-a11f-b807963c0187]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01276b3f-f634-4d07-a1b3-911e42398f09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260]
Nov 18 15:38:22 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260] successful.
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df41623e-329f-41e6-8070-f371e8fe0c8b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f86bb-4f33-40b3-a7c4-b611a9ebb797]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:22 user nova-compute[74839]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)
Nov 18 15:38:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d128a-8ec9-4cf7-9986-94dd85b90afc]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:38:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGDMANPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:38:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:38:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26463383064653232', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:38:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463383064653232', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:38:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lazy-loading 'flavor' on Instance uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:38:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:38:23 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:38:23 user nova-compute[74839]:   <target dev="sdc" bus="scsi"/>
Nov 18 15:38:23 user nova-compute[74839]:   <serial>0256e5af-a0f7-4056-9bcf-93e8b21de449</serial>
Nov 18 15:38:23 user nova-compute[74839]:   <address type="drive" controller="0" unit="2"/>
Nov 18 15:38:23 user nova-compute[74839]: </disk>
Nov 18 15:38:23 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No BDM found with device name sda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] No VIF found with MAC fa:16:3e:46:ca:ee, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f427acbc-187a-4ab9-8365-ff8225c9dc9e tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.366s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:24 user nova-compute[74839]: INFO nova.compute.manager [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Detaching volume 0256e5af-a0f7-4056-9bcf-93e8b21de449
Nov 18 15:38:24 user nova-compute[74839]: INFO nova.virt.block_device [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Attempting to driver detach volume 0256e5af-a0f7-4056-9bcf-93e8b21de449 from mountpoint /dev/sdc
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Attempting to detach device sdc from instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:38:24 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:38:24 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:38:24 user nova-compute[74839]:   <target dev="sdc" bus="scsi"/>
Nov 18 15:38:24 user nova-compute[74839]:   <serial>0256e5af-a0f7-4056-9bcf-93e8b21de449</serial>
Nov 18 15:38:24 user nova-compute[74839]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 15:38:24 user nova-compute[74839]: </disk>
Nov 18 15:38:24 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:38:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Successfully detached device sdc from instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 from the persistent domain config.
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:38:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:38:24 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:38:24 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:38:24 user nova-compute[74839]:   <target dev="sdc" bus="scsi"/>
Nov 18 15:38:24 user nova-compute[74839]:   <serial>0256e5af-a0f7-4056-9bcf-93e8b21de449</serial>
Nov 18 15:38:24 user nova-compute[74839]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 18 15:38:24 user nova-compute[74839]: </disk>
Nov 18 15:38:24 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:38:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:38:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-changed-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Refreshing instance network info cache due to event network-changed-471ecda0-d7f6-4e68-946a-5b7286f0445a. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:38:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:33 user nova-compute[74839]: DEBUG nova.network.neutron [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Refreshing network info cache for port 471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:38:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:34 user nova-compute[74839]: DEBUG nova.network.neutron [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updated VIF entry in instance network info cache for port 471ecda0-d7f6-4e68-946a-5b7286f0445a. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:38:34 user nova-compute[74839]: DEBUG nova.network.neutron [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f81114-44c4-403d-b023-9e2a0d8bfb74 req-b6e00b67-84e6-4d99-b8bd-37779d9e3b56 service nova] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:37 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:38 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:38:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8112MB free_disk=25.412086486816406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a1d1e64c-f034-487e-afe0-c67155ba2984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 45f90ba6-194c-498c-bcfd-e43d0c8fa261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:38:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:38:42 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:42 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:42 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:38:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing instance network info cache due to event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:38:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updated VIF entry in instance network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd998b35-2472-4d11-afdf-7a3dc74c38f9 req-6795f8b2-437d-4fc6-8299-d0787c98a4c4 service nova] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 is timed out.
Nov 18 15:38:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Successfully detached device sdc from instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080 from the live domain config.
Nov 18 15:38:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGDMANPf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:38:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd787605-ad03-44f5-a4c2-a27dec64c87e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:38:45 user nova-compute[74839]: No targets found.
Nov 18 15:38:45 user nova-compute[74839]: iSNS:
Nov 18 15:38:45 user nova-compute[74839]: No targets found.
Nov 18 15:38:45 user nova-compute[74839]: STATIC:
Nov 18 15:38:45 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449
Nov 18 15:38:45 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:38:45 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:38:45 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e
Nov 18 15:38:45 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:38:45 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:38:45 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:38:45 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:38:45 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:38:45 user nova-compute[74839]: FIRMWARE:
Nov 18 15:38:45 user nova-compute[74839]: No targets found.
Nov 18 15:38:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:38:45 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:38:45 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78517da-c7ff-4c9d-a9cf-18b784d4ac4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98f0c4-5476-4121-90b1-7f6e980942a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:45 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:45 user nova-compute[74839]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)
Nov 18 15:38:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:45 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:45 user nova-compute[74839]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 (non-flash)
Nov 18 15:38:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801d67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804f6db-1fb2-42e5-bf30-a2f0b61946ac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6233b59f-e76f-4ff6-8452-23a3025f3f02]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b59a4e-be55-4940-8bc4-b7ad5af39171]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[afacf07f-acec-480b-83e1-dab0439606a0]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a856a0e-b7da-439d-820f-e859203366c5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0197c17a-ac40-4f94-a726-5bfc08d0d899]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260]
Nov 18 15:38:45 user nova-compute[74839]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449, portal: 172.16.0.220,3260] successful.
Nov 18 15:38:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0256e5af-a0f7-4056-9bcf-93e8b21de449 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47390ca5-59ab-4fc4-8bbb-e5cb28d426eb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] <== disconnect_volume: return (303ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:38:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lazy-loading 'flavor' on Instance uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77e18622-4b10-44ab-b592-573c993c8d92 tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.560s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:47 user nova-compute[74839]: INFO nova.compute.manager [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Terminating instance
Nov 18 15:38:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1aaa6ac-aa80-4d9d-8a4e-b3b05875ad7e req-3abb5233-d354-483a-97c4-473cf20c4fad service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Instance destroyed successfully.
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lazy-loading 'resources' on Instance uuid 96e7f6d0-b135-4af1-b743-6fd29c1e0080 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-18T15:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-792549843',display_name='tempest-AttachSCSIVolumeTestJSON-server-792549843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-792549843',id=15,image_ref='bc13b140-07e4-4248-af85-3e206f45926e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4dUNdR1pehlaWR+1TxwTTPqCMi12qDqgDWHFfxzT+Q2kr3qi1XC1O4WC2mU4h5XO89fOiJFp+O5YiXQpN38UIUwQvPfxYiPG7F1z1v5NIDm1bts0ApgMvEsgFkaNYKSw==',key_name='tempest-keypair-1046715440',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d9910968064dfd85bc4d7652da9efc',ramdisk_id='',reservation_id='r-e8621smk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc13b140-07e4-4248-af85-3e206f45926e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-74390954',owner_user_name='tempest-AttachSCSIVolumeTestJSON-74390954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:36:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='253c9dda2d7349dc9b31386d35076d54',uuid=96e7f6d0-b135-4af1-b743-6fd29c1e0080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converting VIF {"id": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "address": "fa:16:3e:46:ca:ee", "network": {"id": "0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-657503542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d9910968064dfd85bc4d7652da9efc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap562cd7d9-7d", "ovs_interfaceid": "562cd7d9-7d92-4e2d-9ef0-0c195bd20131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG os_vif [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap562cd7d9-7d, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ada4f355-08d0-4f7a-bf03-a020d2288fd9) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: INFO os_vif [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:ca:ee,bridge_name='br-int',has_traffic_filtering=True,id=562cd7d9-7d92-4e2d-9ef0-0c195bd20131,network=Network(0e56c5c6-e3c7-4551-91e5-3b1a74ded9b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap562cd7d9-7d')
Nov 18 15:38:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Deleting instance files /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080_del
Nov 18 15:38:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Deletion of /opt/stack/data/nova/instances/96e7f6d0-b135-4af1-b743-6fd29c1e0080_del complete
Nov 18 15:38:48 user nova-compute[74839]: INFO nova.compute.manager [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 18 15:38:48 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:49 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:49 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Took 1.48 seconds to deallocate network for instance.
Nov 18 15:38:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-630cc47c-9223-4946-8dba-b111e7b26965 req-0fe02392-5c70-483e-8df1-d816202c8c3e service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-deleted-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:50 user nova-compute[74839]: WARNING nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state deleted and task_state None.
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:50 user nova-compute[74839]: WARNING nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state deleted and task_state None.
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:50 user nova-compute[74839]: WARNING nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state deleted and task_state None.
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:50 user nova-compute[74839]: WARNING nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-unplugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state deleted and task_state None.
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Acquiring lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] No waiting events found dispatching network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:50 user nova-compute[74839]: WARNING nova.compute.manager [req-afa09dd5-3931-4475-afb2-02f530262f65 req-18b73455-ffad-49f9-91a9-b31aa828b2ea service nova] [instance: 96e7f6d0-b135-4af1-b743-6fd29c1e0080] Received unexpected event network-vif-plugged-562cd7d9-7d92-4e2d-9ef0-0c195bd20131 for instance with vm_state deleted and task_state None.
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:50 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Deleted allocations for instance 96e7f6d0-b135-4af1-b743-6fd29c1e0080
Nov 18 15:38:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aec91491-b3ee-4291-a996-ba9933e908ac tempest-AttachSCSIVolumeTestJSON-74390954 tempest-AttachSCSIVolumeTestJSON-74390954-project-member] Lock "96e7f6d0-b135-4af1-b743-6fd29c1e0080" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.850s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:38:52 user nova-compute[74839]: INFO nova.compute.claims [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Claim successful on node user
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-changed-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Refreshing instance network info cache due to event network-changed-8063c375-a435-4adb-a8c7-46a1fce9e1a6. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] Acquiring lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] Acquired lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Refreshing network info cache for port 8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:38:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:38:52 user nova-compute[74839]: INFO nova.virt.block_device [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Booting with volume a05ce800-f75f-4068-bda2-e9d210c09642 at /dev/vda
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.policy [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1d3ae80cd414152b3c51e35c7a646c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f40fb1770c1247d58f861fa4bb3aa8f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updated VIF entry in instance network info cache for port 8063c375-a435-4adb-a8c7-46a1fce9e1a6. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updating instance_info_cache with network_info: [{"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a69723b7-3fe8-43e9-8f5d-7e497ab8d17f req-5b9e7a6b-fc27-4652-8e2f-5ed6919b81c5 service nova] Releasing lock "refresh_cache-45f90ba6-194c-498c-bcfd-e43d0c8fa261" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG os_brick.utils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b574abc-3aa9-44ae-bc7c-67f30765874d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d9940d-8155-4fa9-9884-eb64cb59d455]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacad37b-de3e-4ee7-bc8e-e7e945c1a552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[041868c2-9ec6-44f8-8fa4-142aeb149d40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:38:53 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25094e21-ce15-45de-a074-9e3b6c2e5b2f]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG os_brick.utils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating existing volume attachment record: 40c2af0e-182a-4c1f-aedc-ecc04097c72e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Successfully created port: a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:53 user nova-compute[74839]: INFO nova.compute.manager [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Terminating instance
Nov 18 15:38:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Successfully updated port: a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquired lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Instance destroyed successfully.
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'resources' on Instance uuid 45f90ba6-194c-498c-bcfd-e43d0c8fa261 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-unplugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] No waiting events found dispatching network-vif-unplugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-unplugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-changed-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Refreshing instance network info cache due to event network-changed-a1af3151-b29a-4b46-b338-f436e2e89525. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Acquiring lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-636770282',display_name='tempest-AttachVolumeNegativeTest-server-636770282',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-636770282',id=18,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFlUG4eXkyPo44dowG+Yl7SIHpt7HKK5NslDeHM7MmQmpVP3E2DoS15sFzkkp/qpQ+5vzSZA6Qehp97QnAKuckRJ95kRZAUJgCo27056dqKr4/ZeGDcRsHAHQliY4cNCw==',key_name='tempest-keypair-131297420',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:37:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-gqy8aawj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:37:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=45f90ba6-194c-498c-bcfd-e43d0c8fa261,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "address": "fa:16:3e:cc:39:d0", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8063c375-a4", "ovs_interfaceid": "8063c375-a435-4adb-a8c7-46a1fce9e1a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG os_vif [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8063c375-a4, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cb27196-ce05-40a2-a2ec-120ca0773307) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:38:54 user nova-compute[74839]: INFO os_vif [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:39:d0,bridge_name='br-int',has_traffic_filtering=True,id=8063c375-a435-4adb-a8c7-46a1fce9e1a6,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8063c375-a4')
Nov 18 15:38:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Deleting instance files /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261_del
Nov 18 15:38:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Deletion of /opt/stack/data/nova/instances/45f90ba6-194c-498c-bcfd-e43d0c8fa261_del complete
Nov 18 15:38:54 user nova-compute[74839]: INFO nova.compute.manager [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating instance_info_cache with network_info: [{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Releasing lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance network_info: |[{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Acquired lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Refreshing network info cache for port a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:38:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updated VIF entry in instance network info cache for port a1af3151-b29a-4b46-b338-f436e2e89525. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating instance_info_cache with network_info: [{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-606117d5-9675-4bf9-9eea-d0c77227a6c4 req-a4be1307-7029-4f87-aedb-f36e7e75152b service nova] Releasing lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:55 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Took 0.69 seconds to deallocate network for instance.
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b20c7a2-39e1-490a-a4b2-596477a34043 req-0b0afe8c-63f8-4e31-87af-b17e8a1f7e0c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-deleted-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:55 user nova-compute[74839]: INFO nova.compute.manager [req-1b20c7a2-39e1-490a-a4b2-596477a34043 req-0b0afe8c-63f8-4e31-87af-b17e8a1f7e0c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Neutron deleted interface 8063c375-a435-4adb-a8c7-46a1fce9e1a6; detaching it from the instance and deleting it from the info cache
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b20c7a2-39e1-490a-a4b2-596477a34043 req-0b0afe8c-63f8-4e31-87af-b17e8a1f7e0c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b20c7a2-39e1-490a-a4b2-596477a34043 req-0b0afe8c-63f8-4e31-87af-b17e8a1f7e0c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Detach interface failed, port_id=8063c375-a435-4adb-a8c7-46a1fce9e1a6, reason: Instance 45f90ba6-194c-498c-bcfd-e43d0c8fa261 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:38:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:55 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Deleted allocations for instance 45f90ba6-194c-498c-bcfd-e43d0c8fa261
Nov 18 15:38:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d9b47062-03e1-4d90-bb62-73bcc999fd62 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.981s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:38:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] Acquiring lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] Lock "45f90ba6-194c-498c-bcfd-e43d0c8fa261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] No waiting events found dispatching network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:38:56 user nova-compute[74839]: WARNING nova.compute.manager [req-88c8ede3-94c6-4afe-a709-daff7fbd5b70 req-fcdf4d42-b233-4463-91c6-2d4061a7900c service nova] [instance: 45f90ba6-194c-498c-bcfd-e43d0c8fa261] Received unexpected event network-vif-plugged-8063c375-a435-4adb-a8c7-46a1fce9e1a6 for instance with vm_state deleted and task_state None.
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:38:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Creating image(s)
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start _get_guest_xml network_info=[{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '40c2af0e-182a-4c1f-aedc-ecc04097c72e', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a05ce800-f75f-4068-bda2-e9d210c09642', 'serial': 'a05ce800-f75f-4068-bda2-e9d210c09642'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:38:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:38:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:38:58 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:38:58 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:38:58 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fcb4c2-ca5d-4e59-ac44-3fbe2f879931]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:38:58 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07912a4e-4793-4b46-9640-99be44f93c75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642] added
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d2a98d-0c52-426f-a2b9-3a414d2d38dd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72565ddd-3a55-4a0a-b130-a413a4358761]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBJTHrRI {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBJTHrRI" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f64fe-a5dd-48a0-8678-48357b8b798a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBJTHrRI'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f8f9e-f92b-4eec-a3f3-0ddd97911f38]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8386be3a-89f4-42a9-8fe0-fae3b2553ec2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cf945-f944-42f0-a2d2-4ed5169b14ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]
Nov 18 15:38:59 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9809d23-b0c2-4b45-9ab5-633079f61c0b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c70110-b627-4b47-9fad-ec5c82e277aa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:38:59 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:38:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ab557-8c2d-4b98-8463-b27bbe491916]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:38:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23562336264353637', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562336264353637', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-96101612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:39:00 user nova-compute[74839]:   <uuid>8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</uuid>
Nov 18 15:39:00 user nova-compute[74839]:   <name>instance-00000013</name>
Nov 18 15:39:00 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:39:00 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:39:00 user nova-compute[74839]:   <metadata>
Nov 18 15:39:00 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:39:00 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:39:00 user nova-compute[74839]:       <nova:name>tempest-ServerActionsV293TestJSON-server-96101612</nova:name>
Nov 18 15:39:00 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:38:58</nova:creationTime>
Nov 18 15:39:00 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:39:00 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:39:00 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:39:00 user nova-compute[74839]:       <nova:owner>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:user uuid="a1d3ae80cd414152b3c51e35c7a646c5">tempest-ServerActionsV293TestJSON-205242596-project-member</nova:user>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:project uuid="f40fb1770c1247d58f861fa4bb3aa8f8">tempest-ServerActionsV293TestJSON-205242596</nova:project>
Nov 18 15:39:00 user nova-compute[74839]:       </nova:owner>
Nov 18 15:39:00 user nova-compute[74839]:       <nova:ports>
Nov 18 15:39:00 user nova-compute[74839]:         <nova:port uuid="a1af3151-b29a-4b46-b338-f436e2e89525">
Nov 18 15:39:00 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 15:39:00 user nova-compute[74839]:         </nova:port>
Nov 18 15:39:00 user nova-compute[74839]:       </nova:ports>
Nov 18 15:39:00 user nova-compute[74839]:     </nova:instance>
Nov 18 15:39:00 user nova-compute[74839]:   </metadata>
Nov 18 15:39:00 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:39:00 user nova-compute[74839]:     <system>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="serial">8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</entry>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="uuid">8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</entry>
Nov 18 15:39:00 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:39:00 user nova-compute[74839]:     </system>
Nov 18 15:39:00 user nova-compute[74839]:   </sysinfo>
Nov 18 15:39:00 user nova-compute[74839]:   <os>
Nov 18 15:39:00 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:39:00 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:39:00 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:39:00 user nova-compute[74839]:   </os>
Nov 18 15:39:00 user nova-compute[74839]:   <features>
Nov 18 15:39:00 user nova-compute[74839]:     <acpi/>
Nov 18 15:39:00 user nova-compute[74839]:     <apic/>
Nov 18 15:39:00 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:39:00 user nova-compute[74839]:   </features>
Nov 18 15:39:00 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:39:00 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:39:00 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:39:00 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:39:00 user nova-compute[74839]:   </clock>
Nov 18 15:39:00 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:39:00 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:39:00 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:39:00 user nova-compute[74839]:   </cpu>
Nov 18 15:39:00 user nova-compute[74839]:   <devices>
Nov 18 15:39:00 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:39:00 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:39:00 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 15:39:00 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:39:00 user nova-compute[74839]:       <serial>a05ce800-f75f-4068-bda2-e9d210c09642</serial>
Nov 18 15:39:00 user nova-compute[74839]:     </disk>
Nov 18 15:39:00 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:39:00 user nova-compute[74839]:       <mac address="fa:16:3e:f2:ae:4a"/>
Nov 18 15:39:00 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:00 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:39:00 user nova-compute[74839]:       <target dev="tapa1af3151-b2"/>
Nov 18 15:39:00 user nova-compute[74839]:     </interface>
Nov 18 15:39:00 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:39:00 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5/console.log" append="off"/>
Nov 18 15:39:00 user nova-compute[74839]:     </serial>
Nov 18 15:39:00 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:39:00 user nova-compute[74839]:     <video>
Nov 18 15:39:00 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:00 user nova-compute[74839]:     </video>
Nov 18 15:39:00 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:39:00 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:39:00 user nova-compute[74839]:     </rng>
Nov 18 15:39:00 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:39:00 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:39:00 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:39:00 user nova-compute[74839]:     </memballoon>
Nov 18 15:39:00 user nova-compute[74839]:   </devices>
Nov 18 15:39:00 user nova-compute[74839]: </domain>
Nov 18 15:39:00 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-96101612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG os_vif [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0135634d-8ab8-534d-9139-98f13ad4f602', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1af3151-b2, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1af3151-b2, col_values=(('qos', UUID('8506bdaa-5fb0-4604-bde0-10f057f9cc66')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1af3151-b2, col_values=(('external_ids', {'iface-id': 'a1af3151-b29a-4b46-b338-f436e2e89525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ae:4a', 'vm-uuid': '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:00 user nova-compute[74839]: INFO os_vif [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2')
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:39:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] No VIF found with MAC fa:16:3e:f2:ae:4a, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:01 user nova-compute[74839]: WARNING nova.compute.manager [req-769e2b50-df16-4093-a6c7-394481e49428 req-4b4c6ef2-7881-4a01-9414-41ad8db3d9eb service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state building and task_state spawning.
Nov 18 15:39:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:39:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance spawned successfully.
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:03 user nova-compute[74839]: WARNING nova.compute.manager [req-d80be54e-6d73-40ff-b767-3a5d815ac5da req-50571953-55c2-408d-9c30-0bcd57250d47 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state building and task_state spawning.
Nov 18 15:39:03 user nova-compute[74839]: INFO nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 18 15:39:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:39:04 user nova-compute[74839]: INFO nova.compute.manager [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Took 11.70 seconds to build instance.
Nov 18 15:39:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4e9bef2a-35ea-4105-b414-aae2cbdce3e1 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.843s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:39:05 user nova-compute[74839]: INFO nova.compute.claims [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Claim successful on node user
Nov 18 15:39:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:39:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:39:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:39:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Creating image(s)
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG nova.policy [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7acc8cec037e4e0081c72125cc4c6db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfa5a922984458fbccbdebc0a906763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk 1073741824" returned: 0 in 0.050s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Cannot resize image /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Ensure instance console log exists: /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Successfully created port: 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Successfully updated port: 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing instance network info cache due to event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:39:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance network_info: |[{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start _get_guest_xml network_info=[{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:39:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrvGpCDvOQwk0TLgwbzhuqbUVWtzPRU+oZGOqRTB12Jz2GHKlSVrOxXFQwqzpfsQht1kM5sBNtXEQ3yMHb9LeU8De+J0se0lfX83pGoINtHolXN4bSplywzQRFG/ZSMKQ==',key_name='tempest-keypair-864750464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_devices' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:39:08 user nova-compute[74839]:   <uuid>693e326d-b414-425b-b318-6f57486154a2</uuid>
Nov 18 15:39:08 user nova-compute[74839]:   <name>instance-00000014</name>
Nov 18 15:39:08 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:39:08 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:39:08 user nova-compute[74839]:   <metadata>
Nov 18 15:39:08 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:39:08 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1895332168</nova:name>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:39:08</nova:creationTime>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:39:08 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:39:08 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:owner>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:user uuid="7acc8cec037e4e0081c72125cc4c6db9">tempest-AttachVolumeShelveTestJSON-619260582-project-member</nova:user>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:project uuid="9bfa5a922984458fbccbdebc0a906763">tempest-AttachVolumeShelveTestJSON-619260582</nova:project>
Nov 18 15:39:08 user nova-compute[74839]:       </nova:owner>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:39:08 user nova-compute[74839]:       <nova:ports>
Nov 18 15:39:08 user nova-compute[74839]:         <nova:port uuid="34c9c001-9d3b-40d9-a028-4af1c6d5cc49">
Nov 18 15:39:08 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 15:39:08 user nova-compute[74839]:         </nova:port>
Nov 18 15:39:08 user nova-compute[74839]:       </nova:ports>
Nov 18 15:39:08 user nova-compute[74839]:     </nova:instance>
Nov 18 15:39:08 user nova-compute[74839]:   </metadata>
Nov 18 15:39:08 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:39:08 user nova-compute[74839]:     <system>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="serial">693e326d-b414-425b-b318-6f57486154a2</entry>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="uuid">693e326d-b414-425b-b318-6f57486154a2</entry>
Nov 18 15:39:08 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:39:08 user nova-compute[74839]:     </system>
Nov 18 15:39:08 user nova-compute[74839]:   </sysinfo>
Nov 18 15:39:08 user nova-compute[74839]:   <os>
Nov 18 15:39:08 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:39:08 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:39:08 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:39:08 user nova-compute[74839]:   </os>
Nov 18 15:39:08 user nova-compute[74839]:   <features>
Nov 18 15:39:08 user nova-compute[74839]:     <acpi/>
Nov 18 15:39:08 user nova-compute[74839]:     <apic/>
Nov 18 15:39:08 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:39:08 user nova-compute[74839]:   </features>
Nov 18 15:39:08 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:39:08 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:39:08 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:39:08 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:39:08 user nova-compute[74839]:   </clock>
Nov 18 15:39:08 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:39:08 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:39:08 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:39:08 user nova-compute[74839]:   </cpu>
Nov 18 15:39:08 user nova-compute[74839]:   <devices>
Nov 18 15:39:08 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:39:08 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:39:08 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk"/>
Nov 18 15:39:08 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:39:08 user nova-compute[74839]:     </disk>
Nov 18 15:39:08 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:39:08 user nova-compute[74839]:       <mac address="fa:16:3e:e8:4b:72"/>
Nov 18 15:39:08 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:08 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:39:08 user nova-compute[74839]:       <target dev="tap34c9c001-9d"/>
Nov 18 15:39:08 user nova-compute[74839]:     </interface>
Nov 18 15:39:08 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:39:08 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/console.log" append="off"/>
Nov 18 15:39:08 user nova-compute[74839]:     </serial>
Nov 18 15:39:08 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:39:08 user nova-compute[74839]:     <video>
Nov 18 15:39:08 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:08 user nova-compute[74839]:     </video>
Nov 18 15:39:08 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:39:08 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:39:08 user nova-compute[74839]:     </rng>
Nov 18 15:39:08 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:39:08 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:39:08 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:39:08 user nova-compute[74839]:     </memballoon>
Nov 18 15:39:08 user nova-compute[74839]:   </devices>
Nov 18 15:39:08 user nova-compute[74839]: </domain>
Nov 18 15:39:08 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrvGpCDvOQwk0TLgwbzhuqbUVWtzPRU+oZGOqRTB12Jz2GHKlSVrOxXFQwqzpfsQht1kM5sBNtXEQ3yMHb9LeU8De+J0se0lfX83pGoINtHolXN4bSplywzQRFG/ZSMKQ==',key_name='tempest-keypair-864750464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG os_vif [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f29f38e-5d70-5e15-b6b8-da185b400b5f', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34c9c001-9d, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34c9c001-9d, col_values=(('qos', UUID('21e58b60-0407-4529-b62c-25fa1ff9934e')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34c9c001-9d, col_values=(('external_ids', {'iface-id': '34c9c001-9d3b-40d9-a028-4af1c6d5cc49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:4b:72', 'vm-uuid': '693e326d-b414-425b-b318-6f57486154a2'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:08 user nova-compute[74839]: INFO os_vif [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d')
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No VIF found with MAC fa:16:3e:e8:4b:72, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updated VIF entry in instance network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b0faa2e-9059-47a1-adc0-2ac3f7150b03 req-98f49025-5572-45c3-af6e-24578660574b service nova] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.014s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:10 user nova-compute[74839]: WARNING nova.compute.manager [req-368586cc-aed1-4a02-8d06-9250fb0a0faa req-ba10ed30-b481-408f-a6eb-863c672ca9ec service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state building and task_state spawning.
Nov 18 15:39:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:39:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:39:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance spawned successfully.
Nov 18 15:39:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:12 user nova-compute[74839]: WARNING nova.compute.manager [req-6722ffef-e807-4bc9-ade3-4f1a39ce7deb req-5e469ed5-e3a5-4275-86d2-806b80bed3ae service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state building and task_state spawning.
Nov 18 15:39:12 user nova-compute[74839]: INFO nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 18 15:39:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:39:12 user nova-compute[74839]: INFO nova.compute.manager [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Took 7.17 seconds to build instance.
Nov 18 15:39:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-411f571d-ff4a-4df9-b3ae-495dcf5a1be0 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.284s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:39:20 user nova-compute[74839]: INFO nova.compute.claims [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Claim successful on node user
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:39:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:39:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG nova.policy [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b3b23664b394fae9ce3bb99461fe9e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0791e06caa2f4df2b8415d8014888775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:39:21 user nova-compute[74839]: INFO nova.virt.block_device [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Booting with volume 9a32176d-b2f5-4758-861a-ef71a0deb3cb at /dev/vda
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.utils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d9ec63-332b-4d9c-99f8-274e557cd28f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e45c51-e5bc-4e0d-87f7-0e9cbccf5975]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41c418-589c-4488-997e-de1e8f18674e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fc800-2c79-445e-9a19-fdc7e43af936]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:39:21 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:39:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433c0ac-9136-4430-afe7-17804d7a6d7b]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG os_brick.utils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating existing volume attachment record: e212092c-ab86-4054-9c9a-cbd8eb6ca109 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:39:21 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Successfully created port: 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Successfully updated port: 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing instance network info cache due to event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance network_info: |[{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:22 user nova-compute[74839]: DEBUG nova.network.neutron [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:39:23 user nova-compute[74839]: DEBUG nova.network.neutron [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updated VIF entry in instance network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:39:23 user nova-compute[74839]: DEBUG nova.network.neutron [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86d943e5-6801-4328-834f-b3f2bef08632 req-f61f1c77-46cb-4ef8-bdec-9fda7fd444a0 service nova] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:39:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Creating image(s)
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Ensure instance console log exists: /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start _get_guest_xml network_info=[{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e212092c-ab86-4054-9c9a-cbd8eb6ca109', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4496a0ec-d5c5-499a-8e93-0cbefac56fca', 'attached_at': '', 'detached_at': '', 'volume_id': '9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'serial': '9a32176d-b2f5-4758-861a-ef71a0deb3cb'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:39:27 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:27 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:39:27 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:39:27 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:39:27 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7537b-5b34-46c2-b142-2952b4a38c55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:39:27 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a3fdc-9d48-4899-a77a-72c236289829]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb] added
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d6d008-eb0b-4189-a9ad-d70ecd04ee6b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[22043147-5bad-4012-a3d5-74ae09263034]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psPecaBQ {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psPecaBQ" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e15cbd-c971-4c9f-8f12-8db441cba325]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psPecaBQ'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170dde2-3b83-4122-a5e1-cc7a8f0f1bfc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f2b4e1-cbcc-4df6-af12-b40b5bbec339]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[514ba2b9-2b71-4a30-8a92-1c8c50195178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]
Nov 18 15:39:27 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d95014-e248-46cb-ac59-24068d96ceaf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfb0ce-ac74-4bd1-8109-0ddf87b9bc08]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:39:27 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:39:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935edd0-e9ac-4cd6-ba7e-d5c96c2c9f7d]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:39:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26665396338363665', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665396338363665', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9vnkihyzUeTz20lvqjRoWPio3VkWICSH0yiHO11eVGVR14m213wnUtK8MeUtKCC9Eb+6FISuzQRLFa7VBJmV7DkEgNXqTlrt29wf9sb+Rq7LU1TTfgmYY65l9w4zgrWQ==',key_name='tempest-TestShelveInstance-1435268891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:21Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'pci_devices' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:39:28 user nova-compute[74839]:   <uuid>4496a0ec-d5c5-499a-8e93-0cbefac56fca</uuid>
Nov 18 15:39:28 user nova-compute[74839]:   <name>instance-00000015</name>
Nov 18 15:39:28 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:39:28 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:39:28 user nova-compute[74839]:   <metadata>
Nov 18 15:39:28 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:39:28 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:39:28 user nova-compute[74839]:       <nova:name>tempest-TestShelveInstance-server-287785288</nova:name>
Nov 18 15:39:28 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:39:27</nova:creationTime>
Nov 18 15:39:28 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:39:28 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:39:28 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:39:28 user nova-compute[74839]:       <nova:owner>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:user uuid="9b3b23664b394fae9ce3bb99461fe9e2">tempest-TestShelveInstance-284363904-project-member</nova:user>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:project uuid="0791e06caa2f4df2b8415d8014888775">tempest-TestShelveInstance-284363904</nova:project>
Nov 18 15:39:28 user nova-compute[74839]:       </nova:owner>
Nov 18 15:39:28 user nova-compute[74839]:       <nova:ports>
Nov 18 15:39:28 user nova-compute[74839]:         <nova:port uuid="0c211e29-d8bc-42e5-bfde-9ddd13447595">
Nov 18 15:39:28 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 15:39:28 user nova-compute[74839]:         </nova:port>
Nov 18 15:39:28 user nova-compute[74839]:       </nova:ports>
Nov 18 15:39:28 user nova-compute[74839]:     </nova:instance>
Nov 18 15:39:28 user nova-compute[74839]:   </metadata>
Nov 18 15:39:28 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:39:28 user nova-compute[74839]:     <system>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="serial">4496a0ec-d5c5-499a-8e93-0cbefac56fca</entry>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="uuid">4496a0ec-d5c5-499a-8e93-0cbefac56fca</entry>
Nov 18 15:39:28 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:39:28 user nova-compute[74839]:     </system>
Nov 18 15:39:28 user nova-compute[74839]:   </sysinfo>
Nov 18 15:39:28 user nova-compute[74839]:   <os>
Nov 18 15:39:28 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:39:28 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:39:28 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:39:28 user nova-compute[74839]:   </os>
Nov 18 15:39:28 user nova-compute[74839]:   <features>
Nov 18 15:39:28 user nova-compute[74839]:     <acpi/>
Nov 18 15:39:28 user nova-compute[74839]:     <apic/>
Nov 18 15:39:28 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:39:28 user nova-compute[74839]:   </features>
Nov 18 15:39:28 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:39:28 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:39:28 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:39:28 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:39:28 user nova-compute[74839]:   </clock>
Nov 18 15:39:28 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:39:28 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:39:28 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:39:28 user nova-compute[74839]:   </cpu>
Nov 18 15:39:28 user nova-compute[74839]:   <devices>
Nov 18 15:39:28 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:39:28 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:39:28 user nova-compute[74839]:       <source dev="/dev/sde"/>
Nov 18 15:39:28 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:39:28 user nova-compute[74839]:       <serial>9a32176d-b2f5-4758-861a-ef71a0deb3cb</serial>
Nov 18 15:39:28 user nova-compute[74839]:     </disk>
Nov 18 15:39:28 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:39:28 user nova-compute[74839]:       <mac address="fa:16:3e:13:6a:43"/>
Nov 18 15:39:28 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:28 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:39:28 user nova-compute[74839]:       <target dev="tap0c211e29-d8"/>
Nov 18 15:39:28 user nova-compute[74839]:     </interface>
Nov 18 15:39:28 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:39:28 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca/console.log" append="off"/>
Nov 18 15:39:28 user nova-compute[74839]:     </serial>
Nov 18 15:39:28 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:39:28 user nova-compute[74839]:     <video>
Nov 18 15:39:28 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:28 user nova-compute[74839]:     </video>
Nov 18 15:39:28 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:39:28 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:39:28 user nova-compute[74839]:     </rng>
Nov 18 15:39:28 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:39:28 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:39:28 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:39:28 user nova-compute[74839]:     </memballoon>
Nov 18 15:39:28 user nova-compute[74839]:   </devices>
Nov 18 15:39:28 user nova-compute[74839]: </domain>
Nov 18 15:39:28 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9vnkihyzUeTz20lvqjRoWPio3VkWICSH0yiHO11eVGVR14m213wnUtK8MeUtKCC9Eb+6FISuzQRLFa7VBJmV7DkEgNXqTlrt29wf9sb+Rq7LU1TTfgmYY65l9w4zgrWQ==',key_name='tempest-TestShelveInstance-1435268891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:21Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG os_vif [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3844878b-889f-5339-ae3d-59442720d0f6', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c211e29-d8, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c211e29-d8, col_values=(('qos', UUID('0061ab21-e6ce-4364-9599-6731948cd6f9')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c211e29-d8, col_values=(('external_ids', {'iface-id': '0c211e29-d8bc-42e5-bfde-9ddd13447595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6a:43', 'vm-uuid': '4496a0ec-d5c5-499a-8e93-0cbefac56fca'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:28 user nova-compute[74839]: INFO os_vif [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8')
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:39:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] No VIF found with MAC fa:16:3e:13:6a:43, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:39:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:30 user nova-compute[74839]: WARNING nova.compute.manager [req-7e4b8d6c-b6a3-4711-a8cb-37196d3a30f6 req-f28ce670-1d77-43bd-8276-1a4fff7b2964 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state building and task_state spawning.
Nov 18 15:39:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:39:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance spawned successfully.
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:39:32 user nova-compute[74839]: INFO nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:39:32 user nova-compute[74839]: WARNING nova.compute.manager [req-098b45b8-0b38-4138-b7a1-564e46d99bf9 req-55d54a6e-55d3-454a-b10e-64647bdbe8fb service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state building and task_state spawning.
Nov 18 15:39:32 user nova-compute[74839]: INFO nova.compute.manager [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Took 11.84 seconds to build instance.
Nov 18 15:39:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-34472866-774e-4178-92d4-691f295a8560 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.936s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating instance_info_cache with network_info: [{"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-a1d1e64c-f034-487e-afe0-c67155ba2984" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:40 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:39:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=25.465442657470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a1d1e64c-f034-487e-afe0-c67155ba2984 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 693e326d-b414-425b-b318-6f57486154a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:39:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:45 user nova-compute[74839]: INFO nova.compute.manager [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Detaching volume bd9bfc9d-1756-4a67-b03e-a82b8040445e
Nov 18 15:39:45 user nova-compute[74839]: INFO nova.virt.block_device [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Attempting to driver detach volume bd9bfc9d-1756-4a67-b03e-a82b8040445e from mountpoint /dev/vdb
Nov 18 15:39:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Attempting to detach device vdb from instance a1d1e64c-f034-487e-afe0-c67155ba2984 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:39:45 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:39:45 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:39:45 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:39:45 user nova-compute[74839]:   <serial>bd9bfc9d-1756-4a67-b03e-a82b8040445e</serial>
Nov 18 15:39:45 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:39:45 user nova-compute[74839]: </disk>
Nov 18 15:39:45 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:39:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance a1d1e64c-f034-487e-afe0-c67155ba2984 from the persistent domain config.
Nov 18 15:39:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1d1e64c-f034-487e-afe0-c67155ba2984 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:39:45 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:39:45 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:39:45 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:39:45 user nova-compute[74839]:   <serial>bd9bfc9d-1756-4a67-b03e-a82b8040445e</serial>
Nov 18 15:39:45 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:39:45 user nova-compute[74839]: </disk>
Nov 18 15:39:45 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:39:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:39:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:39:56 user nova-compute[74839]: INFO nova.compute.claims [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Claim successful on node user
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:39:56 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.policy [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75cef6e9b30942779dd9d0fc689c3947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b08331710a14c4d85ccca3fd806055b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:39:56 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Creating image(s)
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:39:56 user nova-compute[74839]: INFO nova.compute.claims [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Claim successful on node user
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk 1073741824" returned: 0 in 0.047s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Successfully created port: bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:39:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.policy [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75cef6e9b30942779dd9d0fc689c3947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b08331710a14c4d85ccca3fd806055b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Cannot resize image /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Ensure instance console log exists: /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:39:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Creating image(s)
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:57 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Successfully updated port: bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-changed-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Refreshing instance network info cache due to event network-changed-bac9dbee-a574-4473-afa0-4c6838c60212. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Successfully created port: 3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk 1073741824" returned: 0 in 0.056s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance network_info: |[{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Refreshing network info cache for port bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start _get_guest_xml network_info=[{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:39:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633021265',display_name='tempest-ServerRescueNegativeTestJSON-server-633021265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633021265',id=22,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-0km87nrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:57Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=defa77fc-949a-4b92-b717-559fa24b7a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.objects.instance [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:39:58 user nova-compute[74839]:   <uuid>defa77fc-949a-4b92-b717-559fa24b7a2c</uuid>
Nov 18 15:39:58 user nova-compute[74839]:   <name>instance-00000016</name>
Nov 18 15:39:58 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:39:58 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:39:58 user nova-compute[74839]:   <metadata>
Nov 18 15:39:58 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:39:58 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-633021265</nova:name>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:39:58</nova:creationTime>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:39:58 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:39:58 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:owner>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:39:58 user nova-compute[74839]:       </nova:owner>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:39:58 user nova-compute[74839]:       <nova:ports>
Nov 18 15:39:58 user nova-compute[74839]:         <nova:port uuid="bac9dbee-a574-4473-afa0-4c6838c60212">
Nov 18 15:39:58 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:39:58 user nova-compute[74839]:         </nova:port>
Nov 18 15:39:58 user nova-compute[74839]:       </nova:ports>
Nov 18 15:39:58 user nova-compute[74839]:     </nova:instance>
Nov 18 15:39:58 user nova-compute[74839]:   </metadata>
Nov 18 15:39:58 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:39:58 user nova-compute[74839]:     <system>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="serial">defa77fc-949a-4b92-b717-559fa24b7a2c</entry>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="uuid">defa77fc-949a-4b92-b717-559fa24b7a2c</entry>
Nov 18 15:39:58 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:39:58 user nova-compute[74839]:     </system>
Nov 18 15:39:58 user nova-compute[74839]:   </sysinfo>
Nov 18 15:39:58 user nova-compute[74839]:   <os>
Nov 18 15:39:58 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:39:58 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:39:58 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:39:58 user nova-compute[74839]:   </os>
Nov 18 15:39:58 user nova-compute[74839]:   <features>
Nov 18 15:39:58 user nova-compute[74839]:     <acpi/>
Nov 18 15:39:58 user nova-compute[74839]:     <apic/>
Nov 18 15:39:58 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:39:58 user nova-compute[74839]:   </features>
Nov 18 15:39:58 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:39:58 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:39:58 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:39:58 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:39:58 user nova-compute[74839]:   </clock>
Nov 18 15:39:58 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:39:58 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:39:58 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:39:58 user nova-compute[74839]:   </cpu>
Nov 18 15:39:58 user nova-compute[74839]:   <devices>
Nov 18 15:39:58 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:39:58 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:39:58 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk"/>
Nov 18 15:39:58 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:39:58 user nova-compute[74839]:     </disk>
Nov 18 15:39:58 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:39:58 user nova-compute[74839]:       <mac address="fa:16:3e:7c:a4:25"/>
Nov 18 15:39:58 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:58 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:39:58 user nova-compute[74839]:       <target dev="tapbac9dbee-a5"/>
Nov 18 15:39:58 user nova-compute[74839]:     </interface>
Nov 18 15:39:58 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:39:58 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/console.log" append="off"/>
Nov 18 15:39:58 user nova-compute[74839]:     </serial>
Nov 18 15:39:58 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:39:58 user nova-compute[74839]:     <video>
Nov 18 15:39:58 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:58 user nova-compute[74839]:     </video>
Nov 18 15:39:58 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:39:58 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:39:58 user nova-compute[74839]:     </rng>
Nov 18 15:39:58 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:39:58 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:39:58 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:39:58 user nova-compute[74839]:     </memballoon>
Nov 18 15:39:58 user nova-compute[74839]:   </devices>
Nov 18 15:39:58 user nova-compute[74839]: </domain>
Nov 18 15:39:58 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633021265',display_name='tempest-ServerRescueNegativeTestJSON-server-633021265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633021265',id=22,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-0km87nrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:57Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=defa77fc-949a-4b92-b717-559fa24b7a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG os_vif [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c6a0e44-5e08-5c9a-af2c-5e69f383114d', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbac9dbee-a5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbac9dbee-a5, col_values=(('qos', UUID('6e6aeec6-c124-4003-8a7f-46d6db8ba739')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbac9dbee-a5, col_values=(('external_ids', {'iface-id': 'bac9dbee-a574-4473-afa0-4c6838c60212', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a4:25', 'vm-uuid': 'defa77fc-949a-4b92-b717-559fa24b7a2c'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Cannot resize image /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Ensure instance console log exists: /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:58 user nova-compute[74839]: INFO os_vif [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5')
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:7c:a4:25, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Successfully updated port: 3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-changed-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Refreshing instance network info cache due to event network-changed-3253eaf4-d5b2-4757-81f6-726faa3af43d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] Acquiring lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updated VIF entry in instance network info cache for port bac9dbee-a574-4473-afa0-4c6838c60212. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-007d543b-19d7-4731-8afd-9ffca0dfe88d req-f1f2190e-2cee-4fef-8eac-bced7dd1ce37 service nova] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance network_info: |[{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] Acquired lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Refreshing network info cache for port 3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start _get_guest_xml network_info=[{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:39:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1198087756',display_name='tempest-ServerRescueNegativeTestJSON-server-1198087756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1198087756',id=23,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-t00lcqia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:58Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=ab26071c-3fb0-4d46-8742-319d53f5a6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:39:59 user nova-compute[74839]:   <uuid>ab26071c-3fb0-4d46-8742-319d53f5a6c3</uuid>
Nov 18 15:39:59 user nova-compute[74839]:   <name>instance-00000017</name>
Nov 18 15:39:59 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:39:59 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:39:59 user nova-compute[74839]:   <metadata>
Nov 18 15:39:59 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:39:59 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1198087756</nova:name>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:39:59</nova:creationTime>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:39:59 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:39:59 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:owner>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:39:59 user nova-compute[74839]:       </nova:owner>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:39:59 user nova-compute[74839]:       <nova:ports>
Nov 18 15:39:59 user nova-compute[74839]:         <nova:port uuid="3253eaf4-d5b2-4757-81f6-726faa3af43d">
Nov 18 15:39:59 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:39:59 user nova-compute[74839]:         </nova:port>
Nov 18 15:39:59 user nova-compute[74839]:       </nova:ports>
Nov 18 15:39:59 user nova-compute[74839]:     </nova:instance>
Nov 18 15:39:59 user nova-compute[74839]:   </metadata>
Nov 18 15:39:59 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:39:59 user nova-compute[74839]:     <system>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="serial">ab26071c-3fb0-4d46-8742-319d53f5a6c3</entry>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="uuid">ab26071c-3fb0-4d46-8742-319d53f5a6c3</entry>
Nov 18 15:39:59 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:39:59 user nova-compute[74839]:     </system>
Nov 18 15:39:59 user nova-compute[74839]:   </sysinfo>
Nov 18 15:39:59 user nova-compute[74839]:   <os>
Nov 18 15:39:59 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:39:59 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:39:59 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:39:59 user nova-compute[74839]:   </os>
Nov 18 15:39:59 user nova-compute[74839]:   <features>
Nov 18 15:39:59 user nova-compute[74839]:     <acpi/>
Nov 18 15:39:59 user nova-compute[74839]:     <apic/>
Nov 18 15:39:59 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:39:59 user nova-compute[74839]:   </features>
Nov 18 15:39:59 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:39:59 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:39:59 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:39:59 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:39:59 user nova-compute[74839]:   </clock>
Nov 18 15:39:59 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:39:59 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:39:59 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:39:59 user nova-compute[74839]:   </cpu>
Nov 18 15:39:59 user nova-compute[74839]:   <devices>
Nov 18 15:39:59 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:39:59 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:39:59 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk"/>
Nov 18 15:39:59 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:39:59 user nova-compute[74839]:     </disk>
Nov 18 15:39:59 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:39:59 user nova-compute[74839]:       <mac address="fa:16:3e:58:26:e9"/>
Nov 18 15:39:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:59 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:39:59 user nova-compute[74839]:       <target dev="tap3253eaf4-d5"/>
Nov 18 15:39:59 user nova-compute[74839]:     </interface>
Nov 18 15:39:59 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:39:59 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/console.log" append="off"/>
Nov 18 15:39:59 user nova-compute[74839]:     </serial>
Nov 18 15:39:59 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:39:59 user nova-compute[74839]:     <video>
Nov 18 15:39:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:39:59 user nova-compute[74839]:     </video>
Nov 18 15:39:59 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:39:59 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:39:59 user nova-compute[74839]:     </rng>
Nov 18 15:39:59 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:39:59 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:39:59 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:39:59 user nova-compute[74839]:     </memballoon>
Nov 18 15:39:59 user nova-compute[74839]:   </devices>
Nov 18 15:39:59 user nova-compute[74839]: </domain>
Nov 18 15:39:59 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1198087756',display_name='tempest-ServerRescueNegativeTestJSON-server-1198087756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1198087756',id=23,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-t00lcqia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:39:58Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=ab26071c-3fb0-4d46-8742-319d53f5a6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG os_vif [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7a80955-8d5a-5911-a1f8-514daaf5b888', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3253eaf4-d5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3253eaf4-d5, col_values=(('qos', UUID('455e5c2d-05ba-4cfb-a664-26ac64f33870')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3253eaf4-d5, col_values=(('external_ids', {'iface-id': '3253eaf4-d5b2-4757-81f6-726faa3af43d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:26:e9', 'vm-uuid': 'ab26071c-3fb0-4d46-8742-319d53f5a6c3'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:39:59 user nova-compute[74839]: INFO os_vif [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5')
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:58:26:e9, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updated VIF entry in instance network info cache for port 3253eaf4-d5b2-4757-81f6-726faa3af43d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06a5a390-eb7b-4c98-a4dd-1116c96ee6ea req-f249620f-bad4-4153-af17-d2a44bbd6659 service nova] Releasing lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:39:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:00 user nova-compute[74839]: WARNING nova.compute.manager [req-d076ab21-bec3-4551-9115-f176d430c6bc req-cfba5a6f-efb8-470d-98a7-415edfd290a9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state building and task_state spawning.
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:01 user nova-compute[74839]: WARNING nova.compute.manager [req-0ea27a43-6208-4e33-afd1-745ed275fe2d req-1fd7c90d-7882-4faf-9955-398daa2e9f32 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state building and task_state spawning.
Nov 18 15:40:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:02 user nova-compute[74839]: WARNING nova.compute.manager [req-e00da4fd-4ee1-402b-b528-f0f058ca3e34 req-7d844bca-d931-4bd8-8858-dfa4f88c5f94 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state building and task_state spawning.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance spawned successfully.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance spawned successfully.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:03 user nova-compute[74839]: WARNING nova.compute.manager [req-9d8d8006-a2ee-4643-9cc0-f2908169ec9a req-37ce35ec-a901-4828-9180-f82bdc6d38a8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state building and task_state spawning.
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.compute.manager [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Took 7.53 seconds to build instance.
Nov 18 15:40:03 user nova-compute[74839]: INFO nova.compute.manager [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Took 6.79 seconds to build instance.
Nov 18 15:40:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-760e39c4-d652-4717-b364-31879ce525b0 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.630s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a8ffc604-6ec5-4cf5-a754-83b880ffa861 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:05 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1d1e64c-f034-487e-afe0-c67155ba2984 is timed out.
Nov 18 15:40:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance a1d1e64c-f034-487e-afe0-c67155ba2984 from the live domain config.
Nov 18 15:40:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksxutNYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:05 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78b95e9-bf70-4d42-afa0-8fdad68f4241]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:40:05 user nova-compute[74839]: No targets found.
Nov 18 15:40:05 user nova-compute[74839]: iSNS:
Nov 18 15:40:05 user nova-compute[74839]: No targets found.
Nov 18 15:40:05 user nova-compute[74839]: STATIC:
Nov 18 15:40:05 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e
Nov 18 15:40:05 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:05 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:05 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:40:05 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:05 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:05 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:40:05 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:05 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:05 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:40:05 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:05 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:05 user nova-compute[74839]: FIRMWARE:
Nov 18 15:40:05 user nova-compute[74839]: No targets found.
Nov 18 15:40:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:40:05 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:40:05 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0827d3-dd24-422f-990b-6704b0bd73b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbbfb8-ac0c-45f6-9bb4-2e33d758769b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:05 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48073ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:40:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.101s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e1c2cd-1157-464e-9c74-86b55e54b711]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332d0c4-2bb3-4f73-81c7-d55b8d0e156f]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[02170cc4-dea9-491e-a617-05aaea9f6608]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853f827-86c0-4b76-8c55-0d4b5c39d8b8]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc40d929-0d1a-48a8-8363-b38124bccfa3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d64e069-6262-4a31-8583-3f51689d0542]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260]
Nov 18 15:40:06 user nova-compute[74839]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e, portal: 172.16.0.220,3260] successful.
Nov 18 15:40:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd9bfc9d-1756-4a67-b03e-a82b8040445e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a1769-634f-48c6-b5f5-86edde2107df]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== disconnect_volume: return (416ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:40:07 user nova-compute[74839]: DEBUG nova.objects.instance [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-19f6aceb-c560-49ad-965d-501081a1e525 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.212s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:40:08 user nova-compute[74839]: INFO nova.compute.claims [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Claim successful on node user
Nov 18 15:40:08 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:40:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.policy [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b86e5899c041e88609206af0613940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0b5e1598374e26b3b0c081e6ca38d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:40:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Creating image(s)
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "/opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.201s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Successfully created port: 3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk 1073741824" returned: 0 in 0.055s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:40:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Cannot resize image /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Ensure instance console log exists: /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Successfully updated port: 3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-changed-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Refreshing instance network info cache due to event network-changed-3cf379f0-ea69-4e0a-b140-585a9bedc218. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] Acquiring lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updating instance_info_cache with network_info: [{"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Instance network_info: |[{"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] Acquired lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Refreshing network info cache for port 3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:40:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Start _get_guest_xml network_info=[{"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:40:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-707643893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-707643893',id=24,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-385k8011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:09Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=13975a6d-cb76-4a2d-9174-4427522bdbf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 13975a6d-cb76-4a2d-9174-4427522bdbf8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:40:11 user nova-compute[74839]:   <uuid>13975a6d-cb76-4a2d-9174-4427522bdbf8</uuid>
Nov 18 15:40:11 user nova-compute[74839]:   <name>instance-00000018</name>
Nov 18 15:40:11 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:40:11 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:40:11 user nova-compute[74839]:   <metadata>
Nov 18 15:40:11 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:40:11 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-707643893</nova:name>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:40:11</nova:creationTime>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:40:11 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:40:11 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:owner>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:40:11 user nova-compute[74839]:       </nova:owner>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:40:11 user nova-compute[74839]:       <nova:ports>
Nov 18 15:40:11 user nova-compute[74839]:         <nova:port uuid="3cf379f0-ea69-4e0a-b140-585a9bedc218">
Nov 18 15:40:11 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 15:40:11 user nova-compute[74839]:         </nova:port>
Nov 18 15:40:11 user nova-compute[74839]:       </nova:ports>
Nov 18 15:40:11 user nova-compute[74839]:     </nova:instance>
Nov 18 15:40:11 user nova-compute[74839]:   </metadata>
Nov 18 15:40:11 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:40:11 user nova-compute[74839]:     <system>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="serial">13975a6d-cb76-4a2d-9174-4427522bdbf8</entry>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="uuid">13975a6d-cb76-4a2d-9174-4427522bdbf8</entry>
Nov 18 15:40:11 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:40:11 user nova-compute[74839]:     </system>
Nov 18 15:40:11 user nova-compute[74839]:   </sysinfo>
Nov 18 15:40:11 user nova-compute[74839]:   <os>
Nov 18 15:40:11 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:40:11 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:40:11 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:40:11 user nova-compute[74839]:   </os>
Nov 18 15:40:11 user nova-compute[74839]:   <features>
Nov 18 15:40:11 user nova-compute[74839]:     <acpi/>
Nov 18 15:40:11 user nova-compute[74839]:     <apic/>
Nov 18 15:40:11 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:40:11 user nova-compute[74839]:   </features>
Nov 18 15:40:11 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:40:11 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:40:11 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:40:11 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:40:11 user nova-compute[74839]:   </clock>
Nov 18 15:40:11 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:40:11 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:40:11 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:40:11 user nova-compute[74839]:   </cpu>
Nov 18 15:40:11 user nova-compute[74839]:   <devices>
Nov 18 15:40:11 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:40:11 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:40:11 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk"/>
Nov 18 15:40:11 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:40:11 user nova-compute[74839]:     </disk>
Nov 18 15:40:11 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:40:11 user nova-compute[74839]:       <mac address="fa:16:3e:1f:ad:6f"/>
Nov 18 15:40:11 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:11 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:40:11 user nova-compute[74839]:       <target dev="tap3cf379f0-ea"/>
Nov 18 15:40:11 user nova-compute[74839]:     </interface>
Nov 18 15:40:11 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:40:11 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/console.log" append="off"/>
Nov 18 15:40:11 user nova-compute[74839]:     </serial>
Nov 18 15:40:11 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:40:11 user nova-compute[74839]:     <video>
Nov 18 15:40:11 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:11 user nova-compute[74839]:     </video>
Nov 18 15:40:11 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:40:11 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:40:11 user nova-compute[74839]:     </rng>
Nov 18 15:40:11 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:40:11 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:40:11 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:40:11 user nova-compute[74839]:     </memballoon>
Nov 18 15:40:11 user nova-compute[74839]:   </devices>
Nov 18 15:40:11 user nova-compute[74839]: </domain>
Nov 18 15:40:11 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-707643893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-707643893',id=24,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-385k8011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:09Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=13975a6d-cb76-4a2d-9174-4427522bdbf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG os_vif [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f31c1e8-21dc-54e2-9844-8b39ea63032e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cf379f0-ea, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cf379f0-ea, col_values=(('qos', UUID('8debd4f3-1239-4c4f-93a6-c46b2ef688b6')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cf379f0-ea, col_values=(('external_ids', {'iface-id': '3cf379f0-ea69-4e0a-b140-585a9bedc218', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ad:6f', 'vm-uuid': '13975a6d-cb76-4a2d-9174-4427522bdbf8'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:11 user nova-compute[74839]: INFO os_vif [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea')
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:1f:ad:6f, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updated VIF entry in instance network info cache for port 3cf379f0-ea69-4e0a-b140-585a9bedc218. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updating instance_info_cache with network_info: [{"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41ba46fe-e3f9-4d33-af4a-bc7af7a07ffa req-be36aff5-652e-4d1e-9faa-c1403243631e service nova] Releasing lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] No waiting events found dispatching network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:12 user nova-compute[74839]: WARNING nova.compute.manager [req-62ef8dd9-9efd-4a3a-b48b-1cdda0767217 req-a8534374-7543-469b-8b32-8ec9fcfb562b service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received unexpected event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 for instance with vm_state building and task_state spawning.
Nov 18 15:40:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:40:14 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Instance spawned successfully.
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] No waiting events found dispatching network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:14 user nova-compute[74839]: WARNING nova.compute.manager [req-9a63370c-9ab2-481b-a808-2e430ed9e1c1 req-5f2744a1-d52d-4bfb-b515-c885c4eb7e96 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received unexpected event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 for instance with vm_state building and task_state spawning.
Nov 18 15:40:14 user nova-compute[74839]: INFO nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 18 15:40:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:40:14 user nova-compute[74839]: INFO nova.compute.manager [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Took 6.23 seconds to build instance.
Nov 18 15:40:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a10dd4f9-7247-41b3-ab22-f5584657397a tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.336s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'flavor' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:27 user nova-compute[74839]: INFO nova.compute.manager [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Attaching volume 670bcb57-1038-4d06-87b0-08842fa4ffb7 to /dev/vdb
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.utils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77608b92-f319-4b8d-8cfe-b12b5191911c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[433dcd12-2398-46ca-91f7-4a317d45bd85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d50ceb-7190-4d39-90a4-013fae4c7b58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a719af-b953-4192-a747-41df8accf377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:40:27 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:40:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b040f2cb-f793-49eb-9487-82d5269629b0]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG os_brick.utils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:27 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating existing volume attachment record: 1e9cf3d7-2643-4f58-8a08-ca9446bb0942 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:40:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:32 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:32 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:32 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4804dd1e-289f-442d-8663-13222f4c458c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:40:32 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[517c3063-a46b-49a2-bb39-81e95e56d16d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689831d-5047-4064-a579-676a52df54b9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2830f5c0-2ec1-4e1b-9a2b-76d2642fae4d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf141a4-5ba6-4330-bf85-d211e8c3eb4a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ohygwvku'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf6fd2-214d-4c3d-a05c-edb5129143db]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9ee69-fd6a-4873-a884-fd39c752d67e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[321adc83-3645-4a34-8f71-43b5bd23ae23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:40:32 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[768db06c-3530-4821-8a5d-8b9063dfec8e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb0f72-045e-41a0-97a4-42c6d1902b01]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:32 user nova-compute[74839]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:32 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895c6f4-4d0f-4971-8d25-f0553b79c52c]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:40:32 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:40:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:33 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:40:33 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'flavor' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:40:33 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:40:33 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:40:33 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:40:33 user nova-compute[74839]:   <serial>670bcb57-1038-4d06-87b0-08842fa4ffb7</serial>
Nov 18 15:40:33 user nova-compute[74839]: </disk>
Nov 18 15:40:33 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:40:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No VIF found with MAC fa:16:3e:6f:dd:da, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:40:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d60ecd22-5633-4494-8635-2ae7a4b7aca5 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.211s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:35 user nova-compute[74839]: INFO nova.compute.manager [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Terminating instance
Nov 18 15:40:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-unplugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] No waiting events found dispatching network-vif-unplugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-815036d1-dc96-4faf-8766-980c0454cc7f req-dedd3255-d747-4fc2-b88d-5043c5ea69e5 service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-unplugged-42902567-498c-4ab8-94eb-760295084938 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:40:35 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Stashing vm_state: active {{(pid=74839) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Instance destroyed successfully.
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'resources' on Instance uuid a1d1e64c-f034-487e-afe0-c67155ba2984 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1323569522',display_name='tempest-AttachVolumeNegativeTest-server-1323569522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1323569522',id=13,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrW//d8rc3WZne92bbUKAWSHQl6N62lf3hhLccwuiJe31zkERvBzdGpni+ce10zfhs1rEx8ZcMuBxav8NWhF/HBG38v/ByODZsp8dZ6EWtbktNvr9j739w89m6yrA2UnA==',key_name='tempest-keypair-355814580',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-9mwpq8dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a1d1e64c-f034-487e-afe0-c67155ba2984,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "42902567-498c-4ab8-94eb-760295084938", "address": "fa:16:3e:ab:ce:0f", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42902567-49", "ovs_interfaceid": "42902567-498c-4ab8-94eb-760295084938", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG os_vif [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42902567-49, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dfa108a-fcc5-4883-afae-8f9910dc3c3b) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:36 user nova-compute[74839]: INFO os_vif [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ce:0f,bridge_name='br-int',has_traffic_filtering=True,id=42902567-498c-4ab8-94eb-760295084938,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42902567-49')
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Deleting instance files /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984_del
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Deletion of /opt/stack/data/nova/instances/a1d1e64c-f034-487e-afe0-c67155ba2984_del complete
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.compute.claims [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Claim successful on node user
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.compute.manager [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating resource usage from migration 281b7361-dd8a-4799-89ba-c39a52553d5a
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.561s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.compute.manager [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Migrating
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:36 user nova-compute[74839]: INFO nova.compute.rpcapi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 18 15:40:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Starting migrate_disk_and_power_off {{(pid=74839) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:37 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Took 1.42 seconds to deallocate network for instance.
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-e9e8e028-7581-4c2c-9455-7fea519e9c4a req-bd84f2cd-84e1-4f7b-adf4-e2c5f782494e service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-deleted-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] Acquiring lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] No waiting events found dispatching network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:37 user nova-compute[74839]: WARNING nova.compute.manager [req-a1d178b2-e0d0-497c-b584-672c67a4bd69 req-9021a1d5-b056-45ad-a0e4-4803d28e13eb service nova] [instance: a1d1e64c-f034-487e-afe0-c67155ba2984] Received unexpected event network-vif-plugged-42902567-498c-4ab8-94eb-760295084938 for instance with vm_state deleted and task_state None.
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance destroyed successfully.
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471ecda0-d7, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2a366a2-46ff-444f-a2c1-bd6699c82ad6) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:38 user nova-compute[74839]: INFO os_vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:40:38 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Deleted allocations for instance a1d1e64c-f034-487e-afe0-c67155ba2984
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:38 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e082e-9c27-4a5e-a7d4-df6f8a58b2db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:40:38 user nova-compute[74839]: No targets found.
Nov 18 15:40:38 user nova-compute[74839]: iSNS:
Nov 18 15:40:38 user nova-compute[74839]: No targets found.
Nov 18 15:40:38 user nova-compute[74839]: STATIC:
Nov 18 15:40:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:40:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:40:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:40:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:40:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:38 user nova-compute[74839]: FIRMWARE:
Nov 18 15:40:38 user nova-compute[74839]: No targets found.
Nov 18 15:40:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:40:38 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:40:38 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f380e-a463-416f-9283-54ac3ca78a8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a223e-4e7c-42ed-ad75-e47590fb80de]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:38 user nova-compute[74839]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48023d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-40d58f03-df87-431c-b454-5b4fcee7a003 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a1d1e64c-f034-487e-afe0-c67155ba2984" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.933s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[429950e2-c9b9-47ca-9393-1bcd946e1b13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52137ba2-cad0-4d8f-be8d-08c0cfc59e28]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5e7da-76e8-4002-8207-cf7efe16fbef]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3ca9a7-011b-4c4c-9212-dde7a6379222]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ffcb49-40a9-42fa-8ab9-62921ad25dcf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1853f-58a5-4372-a605-292b64e9f806]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:40:38 user nova-compute[74839]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:40:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[027734b4-de9d-4849-b4fc-1e9ab6e37f51]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== disconnect_volume: return (362ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_resize/disk /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:40:39 user nova-compute[74839]: INFO nova.compute.claims [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Claim successful on node user
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "cp -r /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_resize/disk /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk" returned: 0 in 0.440s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_resize/disk.info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk.info {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "cp -r /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_resize/disk.info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk.info" returned: 0 in 0.042s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:39 user nova-compute[74839]: WARNING nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state resize_migrating.
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:39 user nova-compute[74839]: WARNING nova.compute.manager [req-4c1302e2-aa32-4f23-9fd9-919dce3f6a22 req-497b34d7-09fe-4b6d-a283-5309468841cc service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state resize_migrating.
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:40:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.policy [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5789c3f8f97b4d58871c77cdd19b969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572badc0c30b4e3ba5b41b49cb2f8ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:40:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Creating image(s)
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Port 471ecda0-d7f6-4e68-946a-5b7286f0445a binding to destination host user is already ACTIVE {{(pid=74839) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk 1073741824" returned: 0 in 0.050s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Successfully created port: 694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Cannot resize image /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Ensure instance console log exists: /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Successfully updated port: 694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating instance_info_cache with network_info: [{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance network_info: |[{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start _get_guest_xml network_info=[{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:40:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:41 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-tempest.common.compute-instance-1745156096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'pci_devices' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:40:41 user nova-compute[74839]:   <uuid>f34ad603-49e5-45a2-9089-a6373aa5e9ad</uuid>
Nov 18 15:40:41 user nova-compute[74839]:   <name>instance-00000019</name>
Nov 18 15:40:41 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:40:41 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:40:41 user nova-compute[74839]:   <metadata>
Nov 18 15:40:41 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:40:41 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:name>tempest-tempest.common.compute-instance-1745156096</nova:name>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:40:41</nova:creationTime>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:40:41 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:40:41 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:owner>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:user uuid="5789c3f8f97b4d58871c77cdd19b969a">tempest-ServerActionsTestOtherA-89343349-project-member</nova:user>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:project uuid="572badc0c30b4e3ba5b41b49cb2f8ed6">tempest-ServerActionsTestOtherA-89343349</nova:project>
Nov 18 15:40:41 user nova-compute[74839]:       </nova:owner>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:40:41 user nova-compute[74839]:       <nova:ports>
Nov 18 15:40:41 user nova-compute[74839]:         <nova:port uuid="694ae7dc-c6e9-4cd6-8141-4b0069246070">
Nov 18 15:40:41 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:40:41 user nova-compute[74839]:         </nova:port>
Nov 18 15:40:41 user nova-compute[74839]:       </nova:ports>
Nov 18 15:40:41 user nova-compute[74839]:     </nova:instance>
Nov 18 15:40:41 user nova-compute[74839]:   </metadata>
Nov 18 15:40:41 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:40:41 user nova-compute[74839]:     <system>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="serial">f34ad603-49e5-45a2-9089-a6373aa5e9ad</entry>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="uuid">f34ad603-49e5-45a2-9089-a6373aa5e9ad</entry>
Nov 18 15:40:41 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:40:41 user nova-compute[74839]:     </system>
Nov 18 15:40:41 user nova-compute[74839]:   </sysinfo>
Nov 18 15:40:41 user nova-compute[74839]:   <os>
Nov 18 15:40:41 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:40:41 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:40:41 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:40:41 user nova-compute[74839]:   </os>
Nov 18 15:40:41 user nova-compute[74839]:   <features>
Nov 18 15:40:41 user nova-compute[74839]:     <acpi/>
Nov 18 15:40:41 user nova-compute[74839]:     <apic/>
Nov 18 15:40:41 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:40:41 user nova-compute[74839]:   </features>
Nov 18 15:40:41 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:40:41 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:40:41 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:40:41 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:40:41 user nova-compute[74839]:   </clock>
Nov 18 15:40:41 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:40:41 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:40:41 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:40:41 user nova-compute[74839]:   </cpu>
Nov 18 15:40:41 user nova-compute[74839]:   <devices>
Nov 18 15:40:41 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:40:41 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:40:41 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk"/>
Nov 18 15:40:41 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:40:41 user nova-compute[74839]:     </disk>
Nov 18 15:40:41 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:40:41 user nova-compute[74839]:       <mac address="fa:16:3e:99:50:2c"/>
Nov 18 15:40:41 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:41 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:40:41 user nova-compute[74839]:       <target dev="tap694ae7dc-c6"/>
Nov 18 15:40:41 user nova-compute[74839]:     </interface>
Nov 18 15:40:41 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:40:41 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/console.log" append="off"/>
Nov 18 15:40:41 user nova-compute[74839]:     </serial>
Nov 18 15:40:41 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:40:41 user nova-compute[74839]:     <video>
Nov 18 15:40:41 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:41 user nova-compute[74839]:     </video>
Nov 18 15:40:41 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:40:41 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:40:41 user nova-compute[74839]:     </rng>
Nov 18 15:40:41 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:40:41 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:40:41 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:40:41 user nova-compute[74839]:     </memballoon>
Nov 18 15:40:41 user nova-compute[74839]:   </devices>
Nov 18 15:40:41 user nova-compute[74839]: </domain>
Nov 18 15:40:41 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-tempest.common.compute-instance-1745156096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_vif [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c2c67af-a0b6-548e-a93d-15007ad217f1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b7c311-1a80-487b-9870-fc7d47239c5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap694ae7dc-c6, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap694ae7dc-c6, col_values=(('qos', UUID('74023017-3287-47cc-a85c-44700bfb5044')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap694ae7dc-c6, col_values=(('external_ids', {'iface-id': '694ae7dc-c6e9-4cd6-8141-4b0069246070', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:50:2c', 'vm-uuid': 'f34ad603-49e5-45a2-9089-a6373aa5e9ad'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7154c2e-0963-4bd4-943d-2edf2ad21fb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:41 user nova-compute[74839]: INFO os_vif [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6')
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d70548-16d9-48e8-9363-8a5330a473f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46f488-60bd-451e-820e-e3f440b72142]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:40:41 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312d7a4-84e2-47ac-96f3-61736c7b6528]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:99:50:2c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:41 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-changed-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Refreshing instance network info cache due to event network-changed-694ae7dc-c6e9-4cd6-8141-4b0069246070. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] Acquiring lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] Acquired lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Refreshing network info cache for port 694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updated VIF entry in instance network info cache for port 694ae7dc-c6e9-4cd6-8141-4b0069246070. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating instance_info_cache with network_info: [{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fdb5aa88-ea2e-4f9c-b370-f8ec26e6dd08 req-cfddb2ae-aba3-468e-8ccc-826ed795c8e6 service nova] Releasing lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-changed-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Refreshing instance network info cache due to event network-changed-a1af3151-b29a-4b46-b338-f436e2e89525. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] Acquiring lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] Acquired lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Refreshing network info cache for port a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:43 user nova-compute[74839]: WARNING nova.compute.manager [req-0645bdf1-0d51-4ed7-9331-b7dd2723286b req-895fe22e-8859-4a3b-a771-2cdab0967872 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state building and task_state spawning.
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updated VIF entry in instance network info cache for port a1af3151-b29a-4b46-b338-f436e2e89525. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating instance_info_cache with network_info: [{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0eb7a1e0-fa38-45b3-b4cb-b3c813cccc7b req-023f95be-13ff-49b3-85cc-5f6597cb2bce service nova] Releasing lock "refresh_cache-8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:44 user nova-compute[74839]: INFO nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Rebuilding instance
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:40:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:45 user nova-compute[74839]: WARNING nova.compute.manager [req-7bd4f78f-fdc5-449a-96ba-5ccf53aa252f req-83e22b30-12d6-4c14-990f-fec423870fa4 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state active and task_state rebuilding.
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:45 user nova-compute[74839]: WARNING nova.compute.manager [req-480c5626-8a39-42ca-acef-35557e74c4e0 req-8c4f9370-22e3-423d-945a-a5e204ecde6e service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state building and task_state spawning.
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance destroyed successfully.
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:40:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance spawned successfully.
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:40:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance destroyed successfully.
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1612640060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG os_vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1af3151-b2, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8506bdaa-5fb0-4604-bde0-10f057f9cc66) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:40:46 user nova-compute[74839]: INFO os_vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2')
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[242171e9-a446-4369-b5d8-4412734dcadc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]: iSNS:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]: STATIC:
Nov 18 15:40:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:40:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:40:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:40:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:46 user nova-compute[74839]: FIRMWARE:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:40:46 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:40:46 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bf4ec3-dce0-48d9-b71f-0dd2accb6edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[266ab894-5819-43e5-8701-d9e6d8495ea8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: INFO nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4805176d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7076140d-f53a-42cc-bcb2-2462234c8a2b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b50ff2-9dd9-4438-be14-4b93f75b600f]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200de96-3c2a-448d-b310-2fb13c4bd258]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: INFO nova.compute.manager [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Took 6.88 seconds to build instance.
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c72bcad-f91e-4091-b9f5-1cdd9f951052]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b22a9e4-8190-499e-a0a6-03ba016d1001]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-31ec1d0e-f2a3-4010-a245-b848ac42149f tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.063s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d2001-ded3-4666-bc15-6141e9e78190]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]
Nov 18 15:40:46 user nova-compute[74839]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0737dd-c591-4bf6-b5cc-c8ac22790318]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== disconnect_volume: return (438ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:40:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deleting instance files /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5_del
Nov 18 15:40:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deletion of /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5_del complete
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 could not be found.
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8612fbb0-3571-43ae-92ae-f6dda89e269c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]: iSNS:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]: STATIC:
Nov 18 15:40:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:40:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:40:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:40:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:40:46 user nova-compute[74839]: FIRMWARE:
Nov 18 15:40:46 user nova-compute[74839]: No targets found.
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:40:46 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:40:46 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38883c45-1b4f-4c75-878c-ae7a6bc7c763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb147a6-1ce2-4a0c-8166-e8142d8dae87]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:46 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801eb520>, {}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Disconnecting from: [] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== disconnect_volume: return (79ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5' (instance-00000013)
Nov 18 15:40:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:40:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:47 user nova-compute[74839]: WARNING nova.compute.manager [req-d3642ca9-c3c6-4dd2-9587-c3406dae084c req-e85733ba-546c-4592-9d52-5cc6f28ba297 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state active and task_state rebuilding.
Nov 18 15:40:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7654MB free_disk=25.367794036865234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Preparing to wait for external event volume-reimaged-a05ce800-f75f-4068-bda2-e9d210c09642 {{(pid=74839) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Applying migration context for instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 as it has an incoming, in-progress migration 281b7361-dd8a-4799-89ba-c39a52553d5a. Migration status is post-migrating {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 15:40:47 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating resource usage from migration 281b7361-dd8a-4799-89ba-c39a52553d5a
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Starting finish_migration {{(pid=74839) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 15:40:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:40:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Creating image(s)
Nov 18 15:40:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 693e326d-b414-425b-b318-6f57486154a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Migration 281b7361-dd8a-4799-89ba-c39a52553d5a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk. size=21474836480 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk 21474836480 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk 21474836480" returned: 0 in 0.050s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Ensure instance console log exists: /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start _get_guest_xml network_info=[{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '99e89053-813c-4e15-94ca-b320c7695d7c', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '33c2ac3e-6465-4d42-8cf8-15432abc1b53', 'attached_at': '2023-11-18T15:40:48.000000', 'detached_at': '', 'volume_id': '670bcb57-1038-4d06-87b0-08842fa4ffb7', 'serial': '670bcb57-1038-4d06-87b0-08842fa4ffb7'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:40:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:40:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:40:48 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8048f2-4d50-435d-b7cf-b89255e92380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:40:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d825abd-dbe3-41a1-b532-52edba95f7f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb125b-c4c8-4763-ac44-172d80e15912]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e753dd38-4f0f-4cb5-aaaa-6ce8395c2112]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4784204-f79d-4a6a-89c0-7b6cd2603ac8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ohygwvku'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dee11f-bb64-493e-994d-f47a25c6a9b2]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea4935-05a5-448d-95b5-07aef67684ef]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0072ed-abc5-456f-bc39-7b9403a76861]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:40:48 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d861a-487b-4e69-a6d4-0a2033cf293a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[852dc04f-4139-4b54-bab7-8127e9d2b2e4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:40:48 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:40:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96354b-b46a-4720-acbe-815f8edc9f8a]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:40:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:40:49 user nova-compute[74839]:   <uuid>33c2ac3e-6465-4d42-8cf8-15432abc1b53</uuid>
Nov 18 15:40:49 user nova-compute[74839]:   <name>instance-00000010</name>
Nov 18 15:40:49 user nova-compute[74839]:   <memory>2097152</memory>
Nov 18 15:40:49 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:40:49 user nova-compute[74839]:   <metadata>
Nov 18 15:40:49 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:40:49 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherB-server-419458110</nova:name>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:40:48</nova:creationTime>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:flavor name="m1.small">
Nov 18 15:40:49 user nova-compute[74839]:         <nova:memory>2048</nova:memory>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:disk>20</nova:disk>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:40:49 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:owner>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:user uuid="202cc39d991b49468d4922bddcf93381">tempest-ServerActionsTestOtherB-1220678825-project-member</nova:user>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:project uuid="a10ded07c8ca4a14ae16a8b2f568572c">tempest-ServerActionsTestOtherB-1220678825</nova:project>
Nov 18 15:40:49 user nova-compute[74839]:       </nova:owner>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:40:49 user nova-compute[74839]:       <nova:ports>
Nov 18 15:40:49 user nova-compute[74839]:         <nova:port uuid="471ecda0-d7f6-4e68-946a-5b7286f0445a">
Nov 18 15:40:49 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 15:40:49 user nova-compute[74839]:         </nova:port>
Nov 18 15:40:49 user nova-compute[74839]:       </nova:ports>
Nov 18 15:40:49 user nova-compute[74839]:     </nova:instance>
Nov 18 15:40:49 user nova-compute[74839]:   </metadata>
Nov 18 15:40:49 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:40:49 user nova-compute[74839]:     <system>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="serial">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="uuid">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:40:49 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:40:49 user nova-compute[74839]:     </system>
Nov 18 15:40:49 user nova-compute[74839]:   </sysinfo>
Nov 18 15:40:49 user nova-compute[74839]:   <os>
Nov 18 15:40:49 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:40:49 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:40:49 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:40:49 user nova-compute[74839]:   </os>
Nov 18 15:40:49 user nova-compute[74839]:   <features>
Nov 18 15:40:49 user nova-compute[74839]:     <acpi/>
Nov 18 15:40:49 user nova-compute[74839]:     <apic/>
Nov 18 15:40:49 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:40:49 user nova-compute[74839]:   </features>
Nov 18 15:40:49 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:40:49 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:40:49 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:40:49 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:40:49 user nova-compute[74839]:   </clock>
Nov 18 15:40:49 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:40:49 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:40:49 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:40:49 user nova-compute[74839]:   </cpu>
Nov 18 15:40:49 user nova-compute[74839]:   <devices>
Nov 18 15:40:49 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:40:49 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:40:49 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk"/>
Nov 18 15:40:49 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:40:49 user nova-compute[74839]:     </disk>
Nov 18 15:40:49 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:40:49 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:40:49 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 15:40:49 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:40:49 user nova-compute[74839]:       <serial>670bcb57-1038-4d06-87b0-08842fa4ffb7</serial>
Nov 18 15:40:49 user nova-compute[74839]:     </disk>
Nov 18 15:40:49 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:40:49 user nova-compute[74839]:       <mac address="fa:16:3e:6f:dd:da"/>
Nov 18 15:40:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:49 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:40:49 user nova-compute[74839]:       <target dev="tap471ecda0-d7"/>
Nov 18 15:40:49 user nova-compute[74839]:     </interface>
Nov 18 15:40:49 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:40:49 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/console.log" append="off"/>
Nov 18 15:40:49 user nova-compute[74839]:     </serial>
Nov 18 15:40:49 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:40:49 user nova-compute[74839]:     <video>
Nov 18 15:40:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:40:49 user nova-compute[74839]:     </video>
Nov 18 15:40:49 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:40:49 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:40:49 user nova-compute[74839]:     </rng>
Nov 18 15:40:49 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:40:49 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:40:49 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:40:49 user nova-compute[74839]:     </memballoon>
Nov 18 15:40:49 user nova-compute[74839]:   </devices>
Nov 18 15:40:49 user nova-compute[74839]: </domain>
Nov 18 15:40:49 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1182669428-network", "vif_mac": "fa:16:3e:6f:dd:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG os_vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69c742f1-0607-5744-96f4-3a6b414d439e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471ecda0-d7, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap471ecda0-d7, col_values=(('qos', UUID('705ffe51-77a9-4e9f-85f6-672c4546071d')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap471ecda0-d7, col_values=(('external_ids', {'iface-id': '471ecda0-d7f6-4e68-946a-5b7286f0445a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:dd:da', 'vm-uuid': '33c2ac3e-6465-4d42-8cf8-15432abc1b53'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:49 user nova-compute[74839]: INFO os_vif [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:40:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:40:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] No VIF found with MAC fa:16:3e:6f:dd:da, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:51 user nova-compute[74839]: WARNING nova.compute.manager [req-8a193c22-3c63-441c-8842-3f88f967f007 req-1ed9471c-1f6f-4a44-a180-27e66b02f800 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state resize_finish.
Nov 18 15:40:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:40:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance running successfully.
Nov 18 15:40:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Failed to set time: agent not configured {{(pid=74839) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-39886a69-4e8f-4b12-9750-84fb609fe811 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] finish_migration finished successfully. {{(pid=74839) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:40:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:40:53 user nova-compute[74839]: WARNING nova.compute.manager [req-392f7f6c-7b52-49df-be5f-7d2df6b652d2 req-441ea767-c011-4051-9396-0d679987d183 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state resize_finish.
Nov 18 15:40:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:40:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:40:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing instance network info cache due to event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:40:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:40:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:40:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:40:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updated VIF entry in instance network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:40:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:40:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-567845b9-eab7-4aa6-a4ba-c18f2bbfadd6 req-9033a422-9795-454b-8850-d42650179960 service nova] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:40:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:40:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:40:59 user nova-compute[74839]: INFO nova.compute.manager [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Shelving
Nov 18 15:40:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:40:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:00 user nova-compute[74839]: WARNING nova.compute.manager [req-bb2aea33-d903-42e3-b1ac-c17df3348571 req-f89ce3ce-e719-4abd-a48b-b61f945a2c8f service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state active and task_state shelving.
Nov 18 15:41:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance destroyed successfully.
Nov 18 15:41:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Beginning cold snapshot process
Nov 18 15:41:00 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:41:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk /opt/stack/data/nova/instances/snapshots/tmpai_cfcjy/7954624f9a58464798eecdfdf9ec0f26 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:02 user nova-compute[74839]: WARNING nova.compute.manager [req-d61ba003-bc5e-4a88-ab33-889657efd8c1 req-d815c2ec-c640-47db-af54-aab43e9e80c3 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk /opt/stack/data/nova/instances/snapshots/tmpai_cfcjy/7954624f9a58464798eecdfdf9ec0f26" returned: 0 in 1.933s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Snapshot extracted, beginning image upload
Nov 18 15:41:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 req-a862b99c-60dc-4fda-9db3-6f8d212a6393 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event volume-reimaged-a05ce800-f75f-4068-bda2-e9d210c09642 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 req-a862b99c-60dc-4fda-9db3-6f8d212a6393 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 req-a862b99c-60dc-4fda-9db3-6f8d212a6393 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 req-a862b99c-60dc-4fda-9db3-6f8d212a6393 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 req-a862b99c-60dc-4fda-9db3-6f8d212a6393 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Processing event volume-reimaged-a05ce800-f75f-4068-bda2-e9d210c09642 {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 18 15:41:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:41:02 user nova-compute[74839]: INFO nova.virt.block_device [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Booting with volume a05ce800-f75f-4068-bda2-e9d210c09642 at /dev/vda
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5733cda3-539c-45b3-8e1d-50da05474f85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea819c0-f998-43a3-974f-7ab790aa0bd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6580840-63ec-4eaf-94b1-678d95717845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[64560d53-df4f-4275-a24a-98a92e3cdd46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:41:03 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:41:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439f121-fa69-4129-8874-1cd96f64a1a8]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:41:03 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating existing volume attachment record: adf9b0ca-2cf1-43c3-8778-bd54c6d08b6d {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:41:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Snapshot image upload complete
Nov 18 15:41:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:05 user nova-compute[74839]: INFO nova.compute.manager [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Shelve offloading
Nov 18 15:41:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance destroyed successfully.
Nov 18 15:41:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG nova.network.neutron [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG nova.network.neutron [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing instance network info cache due to event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.network.neutron [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:41:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance destroyed successfully.
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.objects.instance [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'resources' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrvGpCDvOQwk0TLgwbzhuqbUVWtzPRU+oZGOqRTB12Jz2GHKlSVrOxXFQwqzpfsQht1kM5sBNtXEQ3yMHb9LeU8De+J0se0lfX83pGoINtHolXN4bSplywzQRFG/ZSMKQ==',key_name='tempest-keypair-864750464',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:41:05.270353',shelved_host='user',shelved_image_id='76097c37-f108-4189-ab0e-33e76050de24'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG os_vif [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34c9c001-9d, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21e58b60-0407-4529-b62c-25fa1ff9934e) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:06 user nova-compute[74839]: INFO os_vif [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d')
Nov 18 15:41:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Deleting instance files /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2_del
Nov 18 15:41:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Deletion of /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2_del complete
Nov 18 15:41:06 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Deleted allocations for instance 693e326d-b414-425b-b318-6f57486154a2
Nov 18 15:41:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.objects.instance [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'numa_topology' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:06 user nova-compute[74839]: DEBUG nova.objects.base [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<693e326d-b414-425b-b318-6f57486154a2> lazy-loaded attributes: resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updated VIF entry in instance network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap34c9c001-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ab0c7941-fe41-4582-b628-6d915e76e4e2 req-d6f830eb-1f5a-4146-bd36-c33a7b2241b9 service nova] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-868df41e-86ff-45e9-bd61-ad849b736b37 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.410s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:41:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Creating image(s)
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start _get_guest_xml network_info=[{"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'adf9b0ca-2cf1-43c3-8778-bd54c6d08b6d', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a05ce800-f75f-4068-bda2-e9d210c09642', 'serial': 'a05ce800-f75f-4068-bda2-e9d210c09642'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:41:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 15:41:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:41:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:41:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:41:08 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df59ebc-4114-4c10-b3c0-3e7d4cda09bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:41:08 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9899e92-2c3e-4db1-aadd-5604ba8ce1c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642] added
Nov 18 15:41:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1834f0f9-3ec6-4800-ba9f-c103cf20f62a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34a160-2f0e-4c61-86e6-c5b29782117c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBJTHrRI {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBJTHrRI" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1820b478-e510-4234-bbc3-9870d30e28aa]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBJTHrRI'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[180e3e99-c912-4a18-992f-90c2b20029d9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d4242d-46bd-4c03-8942-8f658fae2894]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f38e6f-a3f2-4eef-b09b-a6fb654405c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]
Nov 18 15:41:09 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.
Nov 18 15:41:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ff5e0-bb85-40bb-9db6-bb4682cf3bda]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46279788-bdb3-4a3b-ba4a-3d69f03f3809]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:41:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5275799-3861-4b4d-bc63-a2d4ceb1631a]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:41:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23562336264353637', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562336264353637', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1612640060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:41:10 user nova-compute[74839]:   <uuid>8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</uuid>
Nov 18 15:41:10 user nova-compute[74839]:   <name>instance-00000013</name>
Nov 18 15:41:10 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:41:10 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:41:10 user nova-compute[74839]:   <metadata>
Nov 18 15:41:10 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:41:10 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:41:10 user nova-compute[74839]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1612640060</nova:name>
Nov 18 15:41:10 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:41:08</nova:creationTime>
Nov 18 15:41:10 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:41:10 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:41:10 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:41:10 user nova-compute[74839]:       <nova:owner>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:user uuid="a1d3ae80cd414152b3c51e35c7a646c5">tempest-ServerActionsV293TestJSON-205242596-project-member</nova:user>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:project uuid="f40fb1770c1247d58f861fa4bb3aa8f8">tempest-ServerActionsV293TestJSON-205242596</nova:project>
Nov 18 15:41:10 user nova-compute[74839]:       </nova:owner>
Nov 18 15:41:10 user nova-compute[74839]:       <nova:ports>
Nov 18 15:41:10 user nova-compute[74839]:         <nova:port uuid="a1af3151-b29a-4b46-b338-f436e2e89525">
Nov 18 15:41:10 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 15:41:10 user nova-compute[74839]:         </nova:port>
Nov 18 15:41:10 user nova-compute[74839]:       </nova:ports>
Nov 18 15:41:10 user nova-compute[74839]:     </nova:instance>
Nov 18 15:41:10 user nova-compute[74839]:   </metadata>
Nov 18 15:41:10 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:41:10 user nova-compute[74839]:     <system>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="serial">8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</entry>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="uuid">8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5</entry>
Nov 18 15:41:10 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:41:10 user nova-compute[74839]:     </system>
Nov 18 15:41:10 user nova-compute[74839]:   </sysinfo>
Nov 18 15:41:10 user nova-compute[74839]:   <os>
Nov 18 15:41:10 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:41:10 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:41:10 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:41:10 user nova-compute[74839]:   </os>
Nov 18 15:41:10 user nova-compute[74839]:   <features>
Nov 18 15:41:10 user nova-compute[74839]:     <acpi/>
Nov 18 15:41:10 user nova-compute[74839]:     <apic/>
Nov 18 15:41:10 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:41:10 user nova-compute[74839]:   </features>
Nov 18 15:41:10 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:41:10 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:41:10 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:41:10 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:41:10 user nova-compute[74839]:   </clock>
Nov 18 15:41:10 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:41:10 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:41:10 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:41:10 user nova-compute[74839]:   </cpu>
Nov 18 15:41:10 user nova-compute[74839]:   <devices>
Nov 18 15:41:10 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:41:10 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:41:10 user nova-compute[74839]:       <source dev="/dev/sdd"/>
Nov 18 15:41:10 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:41:10 user nova-compute[74839]:       <serial>a05ce800-f75f-4068-bda2-e9d210c09642</serial>
Nov 18 15:41:10 user nova-compute[74839]:     </disk>
Nov 18 15:41:10 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:41:10 user nova-compute[74839]:       <mac address="fa:16:3e:f2:ae:4a"/>
Nov 18 15:41:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:10 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:41:10 user nova-compute[74839]:       <target dev="tapa1af3151-b2"/>
Nov 18 15:41:10 user nova-compute[74839]:     </interface>
Nov 18 15:41:10 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:41:10 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5/console.log" append="off"/>
Nov 18 15:41:10 user nova-compute[74839]:     </serial>
Nov 18 15:41:10 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:41:10 user nova-compute[74839]:     <video>
Nov 18 15:41:10 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:10 user nova-compute[74839]:     </video>
Nov 18 15:41:10 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:41:10 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:41:10 user nova-compute[74839]:     </rng>
Nov 18 15:41:10 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:41:10 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:41:10 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:41:10 user nova-compute[74839]:     </memballoon>
Nov 18 15:41:10 user nova-compute[74839]:   </devices>
Nov 18 15:41:10 user nova-compute[74839]: </domain>
Nov 18 15:41:10 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1612640060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:41:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG os_vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0135634d-8ab8-534d-9139-98f13ad4f602', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1af3151-b2, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1af3151-b2, col_values=(('qos', UUID('29f4860d-0c72-4072-adae-b008c9187055')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1af3151-b2, col_values=(('external_ids', {'iface-id': 'a1af3151-b29a-4b46-b338-f436e2e89525', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:ae:4a', 'vm-uuid': '8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:10 user nova-compute[74839]: INFO os_vif [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2')
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:41:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] No VIF found with MAC fa:16:3e:f2:ae:4a, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:11 user nova-compute[74839]: WARNING nova.compute.manager [req-6806354f-a8e1-418f-90c1-3213c19ef5a0 req-d02afb68-898b-44ac-b4f3-9a7f9006dac9 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 15:41:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:41:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance spawned successfully.
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.objects.instance [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74839) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-037df788-7e74-4c3e-9ba9-4e85a55e3bc6 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:13 user nova-compute[74839]: WARNING nova.compute.manager [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state active and task_state None.
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing instance network info cache due to event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updated VIF entry in instance network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG nova.network.neutron [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-13173268-ffd5-45df-8799-654303582c95 req-5206ca48-88e3-44ac-a0df-41facc8a136b service nova] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:14 user nova-compute[74839]: INFO nova.compute.manager [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Shelve offloading
Nov 18 15:41:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:14 user nova-compute[74839]: WARNING nova.compute.manager [req-a3920d7e-f225-4fee-997f-847204b9a28d req-aaa2f7f6-0b59-4a57-9148-f2fe6444774a service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance destroyed successfully.
Nov 18 15:41:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:41:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance destroyed successfully.
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'resources' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9vnkihyzUeTz20lvqjRoWPio3VkWICSH0yiHO11eVGVR14m213wnUtK8MeUtKCC9Eb+6FISuzQRLFa7VBJmV7DkEgNXqTlrt29wf9sb+Rq7LU1TTfgmYY65l9w4zgrWQ==',key_name='tempest-TestShelveInstance-1435268891',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:39:32Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_vif [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c211e29-d8, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0061ab21-e6ce-4364-9599-6731948cd6f9) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:41:16 user nova-compute[74839]: INFO os_vif [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8')
Nov 18 15:41:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:41:16 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7080b204-2688-4f40-8369-56e27460e978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:41:16 user nova-compute[74839]: No targets found.
Nov 18 15:41:16 user nova-compute[74839]: iSNS:
Nov 18 15:41:16 user nova-compute[74839]: No targets found.
Nov 18 15:41:16 user nova-compute[74839]: STATIC:
Nov 18 15:41:16 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:41:16 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:41:16 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:41:16 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:41:16 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:41:16 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:41:16 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:41:16 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:41:16 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:41:16 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:41:16 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:41:16 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:41:16 user nova-compute[74839]: FIRMWARE:
Nov 18 15:41:16 user nova-compute[74839]: No targets found.
Nov 18 15:41:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:41:16 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:41:16 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9303e4bf-a0f9-4b06-9f89-49c630446e5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[418c653f-3520-4983-ad1e-6ac54147808a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:41:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480515120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b17cf-4767-44ad-b75e-1ed8f7e57c51]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12773f-d721-47ed-a819-646239f6f9f1]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:17 user nova-compute[74839]: WARNING nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:17 user nova-compute[74839]: WARNING nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:17 user nova-compute[74839]: WARNING nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:17 user nova-compute[74839]: WARNING nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:17 user nova-compute[74839]: WARNING nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state shelving.
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing instance network info cache due to event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.network.neutron [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67677f7-210f-4aae-b4c6-622515e12645]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a2246-ed45-47cd-8ff0-787a3434a440]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[600272c0-d79b-4da6-b3a4-b2a928c5c0bf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10889a07-4826-44a5-b176-b32c108de1e2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]
Nov 18 15:41:17 user nova-compute[74839]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.
Nov 18 15:41:17 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe159e66-624d-440e-81a1-0e723b2b41d4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== disconnect_volume: return (343ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:41:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deleting instance files /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca_del
Nov 18 15:41:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deletion of /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca_del complete
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.network.neutron [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updated VIF entry in instance network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG nova.network.neutron [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": null, "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0c211e29-d8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-65625a0d-4473-4753-97db-ada6de2f0ca3 req-7b7be91c-3fc9-425b-b72d-9250e6ca5686 service nova] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:18 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Deleted allocations for instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca
Nov 18 15:41:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'numa_topology' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG nova.objects.base [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Object Instance<4496a0ec-d5c5-499a-8e93-0cbefac56fca> lazy-loaded attributes: resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c7779426-e9f5-4204-8b40-ae49888a83d7 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.294s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:41:29 user nova-compute[74839]: INFO nova.compute.claims [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Claim successful on node user
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:41:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.policy [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd5091855f2647abba05a98492302656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67202285b746fb80c72ae0d42394d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:41:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Creating image(s)
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "/opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk 1073741824" returned: 0 in 0.055s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Successfully created port: 33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Cannot resize image /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Ensure instance console log exists: /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Successfully updated port: 33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquired lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-changed-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Refreshing instance network info cache due to event network-changed-33039476-4a28-44ae-9841-7ae950ba7b49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:41:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] Acquiring lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating instance_info_cache with network_info: [{"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Releasing lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Instance network_info: |[{"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] Acquired lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Refreshing network info cache for port 33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Start _get_guest_xml network_info=[{"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:41:31 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:31 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1062096145',display_name='tempest-AttachVolumeNegativeTest-server-1062096145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1062096145',id=26,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFtSNLtJjGZEt60lPzopSpOSWJIe03oJtvcRTAcuMll0SA8nKHMEAsKnzyaoLAhzvSUctrV35cFuEKPOHJinct6/XBNBrxM9ovvSU76mDdwiAOhe/GzJCn1f3LvGPLWzw==',key_name='tempest-keypair-2020223622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-3w33fv9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a802622d-75a4-4abd-b94c-fa2e54729b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.objects.instance [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'pci_devices' on Instance uuid a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:41:31 user nova-compute[74839]:   <uuid>a802622d-75a4-4abd-b94c-fa2e54729b91</uuid>
Nov 18 15:41:31 user nova-compute[74839]:   <name>instance-0000001a</name>
Nov 18 15:41:31 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:41:31 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:41:31 user nova-compute[74839]:   <metadata>
Nov 18 15:41:31 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:41:31 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1062096145</nova:name>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:41:31</nova:creationTime>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:41:31 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:41:31 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:owner>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:user uuid="fd5091855f2647abba05a98492302656">tempest-AttachVolumeNegativeTest-183955382-project-member</nova:user>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:project uuid="9d67202285b746fb80c72ae0d42394d5">tempest-AttachVolumeNegativeTest-183955382</nova:project>
Nov 18 15:41:31 user nova-compute[74839]:       </nova:owner>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:41:31 user nova-compute[74839]:       <nova:ports>
Nov 18 15:41:31 user nova-compute[74839]:         <nova:port uuid="33039476-4a28-44ae-9841-7ae950ba7b49">
Nov 18 15:41:31 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 15:41:31 user nova-compute[74839]:         </nova:port>
Nov 18 15:41:31 user nova-compute[74839]:       </nova:ports>
Nov 18 15:41:31 user nova-compute[74839]:     </nova:instance>
Nov 18 15:41:31 user nova-compute[74839]:   </metadata>
Nov 18 15:41:31 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:41:31 user nova-compute[74839]:     <system>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="serial">a802622d-75a4-4abd-b94c-fa2e54729b91</entry>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="uuid">a802622d-75a4-4abd-b94c-fa2e54729b91</entry>
Nov 18 15:41:31 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:41:31 user nova-compute[74839]:     </system>
Nov 18 15:41:31 user nova-compute[74839]:   </sysinfo>
Nov 18 15:41:31 user nova-compute[74839]:   <os>
Nov 18 15:41:31 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:41:31 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:41:31 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:41:31 user nova-compute[74839]:   </os>
Nov 18 15:41:31 user nova-compute[74839]:   <features>
Nov 18 15:41:31 user nova-compute[74839]:     <acpi/>
Nov 18 15:41:31 user nova-compute[74839]:     <apic/>
Nov 18 15:41:31 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:41:31 user nova-compute[74839]:   </features>
Nov 18 15:41:31 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:41:31 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:41:31 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:41:31 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:41:31 user nova-compute[74839]:   </clock>
Nov 18 15:41:31 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:41:31 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:41:31 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:41:31 user nova-compute[74839]:   </cpu>
Nov 18 15:41:31 user nova-compute[74839]:   <devices>
Nov 18 15:41:31 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:41:31 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:41:31 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk"/>
Nov 18 15:41:31 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:41:31 user nova-compute[74839]:     </disk>
Nov 18 15:41:31 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:41:31 user nova-compute[74839]:       <mac address="fa:16:3e:a7:58:4e"/>
Nov 18 15:41:31 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:31 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:41:31 user nova-compute[74839]:       <target dev="tap33039476-4a"/>
Nov 18 15:41:31 user nova-compute[74839]:     </interface>
Nov 18 15:41:31 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:41:31 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/console.log" append="off"/>
Nov 18 15:41:31 user nova-compute[74839]:     </serial>
Nov 18 15:41:31 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:41:31 user nova-compute[74839]:     <video>
Nov 18 15:41:31 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:31 user nova-compute[74839]:     </video>
Nov 18 15:41:31 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:41:31 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:41:31 user nova-compute[74839]:     </rng>
Nov 18 15:41:31 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:41:31 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:41:31 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:41:31 user nova-compute[74839]:     </memballoon>
Nov 18 15:41:31 user nova-compute[74839]:   </devices>
Nov 18 15:41:31 user nova-compute[74839]: </domain>
Nov 18 15:41:31 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1062096145',display_name='tempest-AttachVolumeNegativeTest-server-1062096145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1062096145',id=26,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFtSNLtJjGZEt60lPzopSpOSWJIe03oJtvcRTAcuMll0SA8nKHMEAsKnzyaoLAhzvSUctrV35cFuEKPOHJinct6/XBNBrxM9ovvSU76mDdwiAOhe/GzJCn1f3LvGPLWzw==',key_name='tempest-keypair-2020223622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-3w33fv9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:41:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a802622d-75a4-4abd-b94c-fa2e54729b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG os_vif [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dca3565-5b86-5fcc-9a05-cec6d4dce7d4', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33039476-4a, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33039476-4a, col_values=(('qos', UUID('357281a2-e753-4008-86bf-730f76f490d3')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33039476-4a, col_values=(('external_ids', {'iface-id': '33039476-4a28-44ae-9841-7ae950ba7b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:58:4e', 'vm-uuid': 'a802622d-75a4-4abd-b94c-fa2e54729b91'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:31 user nova-compute[74839]: INFO os_vif [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a')
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:a7:58:4e, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updated VIF entry in instance network info cache for port 33039476-4a28-44ae-9841-7ae950ba7b49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating instance_info_cache with network_info: [{"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-70d73c8c-d255-42a6-91ec-ef5547fde6bf req-b2bf1fe1-007e-4bed-8090-e5e3cf53afd4 service nova] Releasing lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] No waiting events found dispatching network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:32 user nova-compute[74839]: WARNING nova.compute.manager [req-594d1de2-1c42-4ac4-921d-78fd1595dde7 req-e1887ac0-35ce-4509-ab93-a0e080449e28 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received unexpected event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 for instance with vm_state building and task_state spawning.
Nov 18 15:41:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:41:34 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Instance spawned successfully.
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] No waiting events found dispatching network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:34 user nova-compute[74839]: WARNING nova.compute.manager [req-fa611cdb-8d1b-4afe-a54a-1340a8265ac7 req-d0fb3240-d176-4406-8553-4b22449cb534 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received unexpected event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 for instance with vm_state building and task_state spawning.
Nov 18 15:41:34 user nova-compute[74839]: INFO nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 18 15:41:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:35 user nova-compute[74839]: INFO nova.compute.manager [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Took 5.81 seconds to build instance.
Nov 18 15:41:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5971e9e0-2b3a-4f93-b2f3-dbfce006bbc1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.899s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:39 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:41:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:41:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=25.305171966552734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Applying migration context for instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 as it has an incoming, in-progress migration 281b7361-dd8a-4799-89ba-c39a52553d5a. Migration status is finished {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 15:41:46 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating resource usage from migration 281b7361-dd8a-4799-89ba-c39a52553d5a
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Migration 281b7361-dd8a-4799-89ba-c39a52553d5a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a802622d-75a4-4abd-b94c-fa2e54729b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:41:46 user nova-compute[74839]: INFO nova.compute.manager [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Rescuing
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:41:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:47 user nova-compute[74839]: WARNING nova.compute.manager [req-7a7b2184-8060-4a26-9907-57ec3c6e5acf req-16517996-c0b1-4d71-aced-40f3a42fa65e service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state active and task_state rescuing.
Nov 18 15:41:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance destroyed successfully.
Nov 18 15:41:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Attempting rescue
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:41:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Creating image(s)
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue" returned: 0 in 0.052s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'migration_context' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<ab26071c-3fb0-4d46-8742-319d53f5a6c3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start _get_guest_xml network_info=[{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:58:26:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<ab26071c-3fb0-4d46-8742-319d53f5a6c3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'numa_topology' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<ab26071c-3fb0-4d46-8742-319d53f5a6c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<ab26071c-3fb0-4d46-8742-319d53f5a6c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1198087756',display_name='tempest-ServerRescueNegativeTestJSON-server-1198087756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1198087756',id=23,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-t00lcqia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:04Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=ab26071c-3fb0-4d46-8742-319d53f5a6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:58:26:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:58:26:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<ab26071c-3fb0-4d46-8742-319d53f5a6c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:41:48 user nova-compute[74839]:   <uuid>ab26071c-3fb0-4d46-8742-319d53f5a6c3</uuid>
Nov 18 15:41:48 user nova-compute[74839]:   <name>instance-00000017</name>
Nov 18 15:41:48 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:41:48 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:41:48 user nova-compute[74839]:   <metadata>
Nov 18 15:41:48 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:41:48 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1198087756</nova:name>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:41:48</nova:creationTime>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:41:48 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:41:48 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:owner>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:41:48 user nova-compute[74839]:       </nova:owner>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:41:48 user nova-compute[74839]:       <nova:ports>
Nov 18 15:41:48 user nova-compute[74839]:         <nova:port uuid="3253eaf4-d5b2-4757-81f6-726faa3af43d">
Nov 18 15:41:48 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:41:48 user nova-compute[74839]:         </nova:port>
Nov 18 15:41:48 user nova-compute[74839]:       </nova:ports>
Nov 18 15:41:48 user nova-compute[74839]:     </nova:instance>
Nov 18 15:41:48 user nova-compute[74839]:   </metadata>
Nov 18 15:41:48 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:41:48 user nova-compute[74839]:     <system>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="serial">ab26071c-3fb0-4d46-8742-319d53f5a6c3</entry>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="uuid">ab26071c-3fb0-4d46-8742-319d53f5a6c3</entry>
Nov 18 15:41:48 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:41:48 user nova-compute[74839]:     </system>
Nov 18 15:41:48 user nova-compute[74839]:   </sysinfo>
Nov 18 15:41:48 user nova-compute[74839]:   <os>
Nov 18 15:41:48 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:41:48 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:41:48 user nova-compute[74839]:   </os>
Nov 18 15:41:48 user nova-compute[74839]:   <features>
Nov 18 15:41:48 user nova-compute[74839]:     <acpi/>
Nov 18 15:41:48 user nova-compute[74839]:     <apic/>
Nov 18 15:41:48 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:41:48 user nova-compute[74839]:   </features>
Nov 18 15:41:48 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:41:48 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:41:48 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:41:48 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:41:48 user nova-compute[74839]:   </clock>
Nov 18 15:41:48 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:41:48 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:41:48 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:41:48 user nova-compute[74839]:   </cpu>
Nov 18 15:41:48 user nova-compute[74839]:   <devices>
Nov 18 15:41:48 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:41:48 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:41:48 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue"/>
Nov 18 15:41:48 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:41:48 user nova-compute[74839]:     </disk>
Nov 18 15:41:48 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:41:48 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:41:48 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk"/>
Nov 18 15:41:48 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:41:48 user nova-compute[74839]:     </disk>
Nov 18 15:41:48 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:41:48 user nova-compute[74839]:       <mac address="fa:16:3e:58:26:e9"/>
Nov 18 15:41:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:48 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:41:48 user nova-compute[74839]:       <target dev="tap3253eaf4-d5"/>
Nov 18 15:41:48 user nova-compute[74839]:     </interface>
Nov 18 15:41:48 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:41:48 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/console.log" append="off"/>
Nov 18 15:41:48 user nova-compute[74839]:     </serial>
Nov 18 15:41:48 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:41:48 user nova-compute[74839]:     <video>
Nov 18 15:41:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:41:48 user nova-compute[74839]:     </video>
Nov 18 15:41:48 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:41:48 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:41:48 user nova-compute[74839]:     </rng>
Nov 18 15:41:48 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:41:48 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:41:48 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:41:48 user nova-compute[74839]:     </memballoon>
Nov 18 15:41:48 user nova-compute[74839]:   </devices>
Nov 18 15:41:48 user nova-compute[74839]: </domain>
Nov 18 15:41:48 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:41:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance destroyed successfully.
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:41:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:58:26:e9, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:49 user nova-compute[74839]: WARNING nova.compute.manager [req-f705a842-573d-459d-a5c3-bf9a5499e21f req-e5e93a69-96dd-4af8-8546-ed47da4e34ae service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state active and task_state rescuing.
Nov 18 15:41:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3aef5da4-9302-4ce0-9dfc-422164a46165 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:52 user nova-compute[74839]: WARNING nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state active and task_state rescuing.
Nov 18 15:41:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:41:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:41:52 user nova-compute[74839]: WARNING nova.compute.manager [req-8b55fa38-ac87-43a7-bbfe-1ad7ede6a7f4 req-8788b396-ccc6-41fa-a998-5751b22a5ce0 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state active and task_state rescuing.
Nov 18 15:41:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:41:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:41:59 user nova-compute[74839]: INFO nova.compute.manager [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] instance snapshotting
Nov 18 15:41:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Beginning live snapshot process
Nov 18 15:41:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409.delta 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409.delta 1073741824" returned: 0 in 0.056s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 15:42:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:42:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] COPY block job progress, current cursor: 47972352 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:42:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:42:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 15:42:02 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:42:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409.delta /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409.delta /opt/stack/data/nova/instances/snapshots/tmptz1_y56o/081a3fb28f9a437f9a648dd5dedbb409" returned: 0 in 0.405s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Snapshot extracted, beginning image upload
Nov 18 15:42:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Snapshot image upload complete
Nov 18 15:42:05 user nova-compute[74839]: INFO nova.compute.manager [None req-3521f304-18e2-4a12-af66-35df096ef400 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Took 5.82 seconds to snapshot the instance on the hypervisor.
Nov 18 15:42:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Port 471ecda0-d7f6-4e68-946a-5b7286f0445a binding to destination host user is already ACTIVE {{(pid=74839) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG nova.network.neutron [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Creating tmpfile /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/tmpkud_9jkr to verify with other compute node that the instance is on the same shared storage. {{(pid=74839) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:27 user nova-compute[74839]: WARNING nova.compute.manager [req-7a1055e0-636a-4f96-a799-c673de34cb8d req-21dbcd50-fad7-47bb-a78a-617d67e80750 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state resized and task_state resize_reverting.
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance destroyed successfully.
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.objects.instance [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'resources' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471ecda0-d7, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=705ffe51-77a9-4e9f-85f6-672c4546071d) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:27 user nova-compute[74839]: INFO os_vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:27 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ec672-5172-49f3-8d78-2fa794667f69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:42:27 user nova-compute[74839]: No targets found.
Nov 18 15:42:27 user nova-compute[74839]: iSNS:
Nov 18 15:42:27 user nova-compute[74839]: No targets found.
Nov 18 15:42:27 user nova-compute[74839]: STATIC:
Nov 18 15:42:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:42:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:42:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:27 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:42:27 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:27 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:27 user nova-compute[74839]: FIRMWARE:
Nov 18 15:42:27 user nova-compute[74839]: No targets found.
Nov 18 15:42:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:42:27 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:42:27 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c52be1a-9965-46de-a91e-c0137f843420]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d56f4b-fb4b-4052-81e9-bdb0289324ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c610670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6639c4-5227-4173-9e90-318694688a00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8f9fa-124d-4c1d-8aa4-75cef6e713e7]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c052a8-d06c-4d06-b6ac-d9d456a7b6eb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d12507-2f4c-4618-95c6-36f0a6bb8c85]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[703e575a-6098-4833-b50c-e45c57c14d18]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ffdc3d-3bd8-4db5-a7ad-7180c7566b41]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:42:27 user nova-compute[74839]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84854f8-ae38-4672-9bbc-05a16ffe4554]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== disconnect_volume: return (277ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:42:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'migration_context' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:28 user nova-compute[74839]: DEBUG nova.objects.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Object Instance<33c2ac3e-6465-4d42-8cf8-15432abc1b53> lazy-loaded attributes: resources,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.423s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:29 user nova-compute[74839]: WARNING nova.compute.manager [req-1f0fa877-001e-4546-b64f-d0221d8d0b7d req-f599d64f-52ed-4bcc-88a7-656477d5b3f8 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state resized and task_state resize_reverting.
Nov 18 15:42:29 user nova-compute[74839]: INFO nova.compute.manager [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Swapping old allocation on dict_keys(['1b2bc3b9-1976-45c0-acc1-6705a8c2df60']) held by migration 281b7361-dd8a-4799-89ba-c39a52553d5a for instance
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Overwriting current allocation {'allocations': {'1b2bc3b9-1976-45c0-acc1-6705a8c2df60': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': 'a10ded07c8ca4a14ae16a8b2f568572c', 'user_id': '202cc39d991b49468d4922bddcf93381', 'consumer_generation': 1} on consumer 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG os_brick.utils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d041cb70-f109-417b-9419-712d511a767b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd8163-b3bc-4946-a173-a1baa15b5dc8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b51e2-63f2-4bcf-8d9d-c88ecc2964ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd52546-83c7-417a-bf7f-c4fbcbb07f5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:30 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:42:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c4d39a-0148-4432-8b9f-ac1bac9eec23]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-changed-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Refreshing instance network info cache due to event network-changed-694ae7dc-c6e9-4cd6-8141-4b0069246070. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] Acquiring lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] Acquired lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Refreshing network info cache for port 694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updated VIF entry in instance network info cache for port 694ae7dc-c6e9-4cd6-8141-4b0069246070. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating instance_info_cache with network_info: [{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b87db2c9-8995-4ad4-a17d-e402abe5b8ec req-8bae42a9-8c4d-4ff3-9c30-0bbf8c2ce8b9 service nova] Releasing lock "refresh_cache-f34ad603-49e5-45a2-9089-a6373aa5e9ad" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.objects.instance [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'flavor' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:31 user nova-compute[74839]: INFO nova.compute.manager [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attaching volume 03079d99-30ab-419d-a333-cd7c355d8928 to /dev/vdb
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.utils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1474e5-d77a-412f-95fd-fa2c0bc5689b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ef56f-0ef0-441f-be31-757299f23ce1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f67a2d-b120-496b-a93c-d947d10871d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c1f03-3917-425d-ab79-2e8fb978dd21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:31 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:42:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef68eb3-029b-4345-ac76-66e5ed8416a2]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG os_brick.utils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:31 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating existing volume attachment record: b796c9a2-8fd9-440b-9ff0-fd19f1bcba38 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:42:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Starting finish_revert_migration {{(pid=74839) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start _get_guest_xml network_info=[{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '3c77a28b-49a2-4483-83d0-75bac94e11c2', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '33c2ac3e-6465-4d42-8cf8-15432abc1b53', 'attached_at': '2023-11-18T15:42:35.000000', 'detached_at': '', 'volume_id': '670bcb57-1038-4d06-87b0-08842fa4ffb7', 'serial': '670bcb57-1038-4d06-87b0-08842fa4ffb7'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:42:35 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:35 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.objects.instance [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:35 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78466fb2-48c8-4bd9-8fab-2c4b7ca68559]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:42:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accf632-7e01-47aa-9fb2-5d64e0067a6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7] added
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[622dc856-c826-44cd-9eaf-1ca4d9822af2]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9dc63-c284-491f-9014-286fcc581d00]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Ohygwvku" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e32164-0294-4ffb-8068-f25b0f2545fc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Ohygwvku'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb558e03-d2de-456f-9f5b-a44534877c60]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9f295-3669-46f5-a5a1-dde147eac2a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e6030-e354-4fb5-953c-4f1587acc81e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:42:35 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd271fe3-ffa2-4d76-bae9-b55a032f758f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a946e1-be4b-4aba-929b-5671b7dc3fb7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72206d43-3dc3-43af-a69c-c4b1a918f78b]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:42:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:36 user nova-compute[74839]: INFO nova.compute.manager [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Terminating instance
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-9ad8d35d-04d7-46fe-9218-f8bc447359d5 req-af6ecaa6-f9ff-4c80-b6c8-3604fc54b4b5 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-unplugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835613962616236', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:42:36 user nova-compute[74839]:   <uuid>33c2ac3e-6465-4d42-8cf8-15432abc1b53</uuid>
Nov 18 15:42:36 user nova-compute[74839]:   <name>instance-00000010</name>
Nov 18 15:42:36 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:42:36 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:42:36 user nova-compute[74839]:   <metadata>
Nov 18 15:42:36 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:42:36 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherB-server-419458110</nova:name>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:42:35</nova:creationTime>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:42:36 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:42:36 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:owner>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:user uuid="202cc39d991b49468d4922bddcf93381">tempest-ServerActionsTestOtherB-1220678825-project-member</nova:user>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:project uuid="a10ded07c8ca4a14ae16a8b2f568572c">tempest-ServerActionsTestOtherB-1220678825</nova:project>
Nov 18 15:42:36 user nova-compute[74839]:       </nova:owner>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:42:36 user nova-compute[74839]:       <nova:ports>
Nov 18 15:42:36 user nova-compute[74839]:         <nova:port uuid="471ecda0-d7f6-4e68-946a-5b7286f0445a">
Nov 18 15:42:36 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 15:42:36 user nova-compute[74839]:         </nova:port>
Nov 18 15:42:36 user nova-compute[74839]:       </nova:ports>
Nov 18 15:42:36 user nova-compute[74839]:     </nova:instance>
Nov 18 15:42:36 user nova-compute[74839]:   </metadata>
Nov 18 15:42:36 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:42:36 user nova-compute[74839]:     <system>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="serial">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="uuid">33c2ac3e-6465-4d42-8cf8-15432abc1b53</entry>
Nov 18 15:42:36 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:42:36 user nova-compute[74839]:     </system>
Nov 18 15:42:36 user nova-compute[74839]:   </sysinfo>
Nov 18 15:42:36 user nova-compute[74839]:   <os>
Nov 18 15:42:36 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:42:36 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:42:36 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:42:36 user nova-compute[74839]:   </os>
Nov 18 15:42:36 user nova-compute[74839]:   <features>
Nov 18 15:42:36 user nova-compute[74839]:     <acpi/>
Nov 18 15:42:36 user nova-compute[74839]:     <apic/>
Nov 18 15:42:36 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:42:36 user nova-compute[74839]:   </features>
Nov 18 15:42:36 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:42:36 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:42:36 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:42:36 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:42:36 user nova-compute[74839]:   </clock>
Nov 18 15:42:36 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:42:36 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:42:36 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:42:36 user nova-compute[74839]:   </cpu>
Nov 18 15:42:36 user nova-compute[74839]:   <devices>
Nov 18 15:42:36 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:42:36 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:42:36 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk"/>
Nov 18 15:42:36 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:42:36 user nova-compute[74839]:     </disk>
Nov 18 15:42:36 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:42:36 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:42:36 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 15:42:36 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:42:36 user nova-compute[74839]:       <serial>670bcb57-1038-4d06-87b0-08842fa4ffb7</serial>
Nov 18 15:42:36 user nova-compute[74839]:     </disk>
Nov 18 15:42:36 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:42:36 user nova-compute[74839]:       <mac address="fa:16:3e:6f:dd:da"/>
Nov 18 15:42:36 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:36 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:42:36 user nova-compute[74839]:       <target dev="tap471ecda0-d7"/>
Nov 18 15:42:36 user nova-compute[74839]:     </interface>
Nov 18 15:42:36 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:42:36 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/console.log" append="off"/>
Nov 18 15:42:36 user nova-compute[74839]:     </serial>
Nov 18 15:42:36 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:42:36 user nova-compute[74839]:     <video>
Nov 18 15:42:36 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:36 user nova-compute[74839]:     </video>
Nov 18 15:42:36 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:42:36 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:42:36 user nova-compute[74839]:     </rng>
Nov 18 15:42:36 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:42:36 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:42:36 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:42:36 user nova-compute[74839]:     </memballoon>
Nov 18 15:42:36 user nova-compute[74839]:   </devices>
Nov 18 15:42:36 user nova-compute[74839]: </domain>
Nov 18 15:42:36 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69c742f1-0607-5744-96f4-3a6b414d439e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471ecda0-d7, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap471ecda0-d7, col_values=(('qos', UUID('5eb2747b-faae-46b6-80a4-1a32eb93be4f')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap471ecda0-d7, col_values=(('external_ids', {'iface-id': '471ecda0-d7f6-4e68-946a-5b7286f0445a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:dd:da', 'vm-uuid': '33c2ac3e-6465-4d42-8cf8-15432abc1b53'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: INFO os_vif [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:42:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Instance destroyed successfully.
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lazy-loading 'resources' on Instance uuid 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:37 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:37 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:37 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1612640060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-96101612',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN11XGlQglQ0e1riE5TYtdlN7c8/KZCbNlmsqEIlwVlYngb6lf6AEpDvUvn3Fk4Mm17lPVfDAtz8C+aqUcD9xISPMZcA//1+9pwumhpgYCZ2myfCxz80wvSkGKHhijF4QQ==',key_name='tempest-keypair-488856043',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f40fb1770c1247d58f861fa4bb3aa8f8',ramdisk_id='',reservation_id='r-qg0n80im',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-205242596',owner_user_name='tempest-ServerActionsV293TestJSON-205242596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d3ae80cd414152b3c51e35c7a646c5',uuid=8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converting VIF {"id": "a1af3151-b29a-4b46-b338-f436e2e89525", "address": "fa:16:3e:f2:ae:4a", "network": {"id": "10106e48-853c-4776-b9bc-e3cf8c98a269", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1061897162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f40fb1770c1247d58f861fa4bb3aa8f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1af3151-b2", "ovs_interfaceid": "a1af3151-b29a-4b46-b338-f436e2e89525", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_vif [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1af3151-b2, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed55f551-2e88-4eca-8464-bdb6fb4216ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:42:37 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29f4860d-0c72-4072-adae-b008c9187055) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc3081-6be2-4a2c-829f-9339f628862d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928] added
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: INFO os_vif [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:ae:4a,bridge_name='br-int',has_traffic_filtering=True,id=a1af3151-b29a-4b46-b338-f436e2e89525,network=Network(10106e48-853c-4776-b9bc-e3cf8c98a269),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1af3151-b2')
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBJTHrRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:37 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1036e8fb-ba8d-412b-997c-9c2600d872ff]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f509f08b-ada3-485c-b4ea-935d31e00535]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLOsYtQh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLOsYtQh" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f752318-782b-4600-a5c1-4f7ec3c31785]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLOsYtQh'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc790a6-cf2f-4891-9f5b-06d8cd6559f9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[536bc3c4-61e8-4af2-8768-39a648f69def]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[880ec7f7-d9d7-48cf-b89c-5b7e08875bfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]
Nov 18 15:42:37 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9734dc5c-9615-4f4f-98e2-9384cd691d0f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f55efe-b002-4e1a-85ae-1690af0f2b36]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07749621-700a-497d-a48f-898cab0aca9b]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:42:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:38 user nova-compute[74839]: WARNING nova.compute.manager [req-59d8dfdd-bb4c-4927-bac8-24e1805a4e8e req-39bef96b-2c34-4f91-95f7-b459a3ff8e40 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state resized and task_state resize_reverting.
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] Acquiring lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] No waiting events found dispatching network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:38 user nova-compute[74839]: WARNING nova.compute.manager [req-ae547a31-5ada-4cc4-8db7-c3a47ab512e0 req-c7bdec01-21ba-40a4-a0f5-e80fbf8b7698 service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received unexpected event network-vif-plugged-a1af3151-b29a-4b46-b338-f436e2e89525 for instance with vm_state active and task_state deleting.
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23064656631373931', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064656631373931', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.267s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.objects.instance [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'flavor' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d508d21-f03d-4348-98d7-bfc33ca6e24d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:42:38 user nova-compute[74839]: No targets found.
Nov 18 15:42:38 user nova-compute[74839]: iSNS:
Nov 18 15:42:38 user nova-compute[74839]: No targets found.
Nov 18 15:42:38 user nova-compute[74839]: STATIC:
Nov 18 15:42:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:42:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642
Nov 18 15:42:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:42:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:42:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:38 user nova-compute[74839]: FIRMWARE:
Nov 18 15:42:38 user nova-compute[74839]: No targets found.
Nov 18 15:42:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:42:38 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:42:38 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab77a63d-299a-41da-8e3a-4f6effbaf6bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:42:38 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:42:38 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 15:42:38 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:42:38 user nova-compute[74839]:   <serial>03079d99-30ab-419d-a333-cd7c355d8928</serial>
Nov 18 15:42:38 user nova-compute[74839]: </disk>
Nov 18 15:42:38 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a6494-924f-4102-8875-ea05281d73fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801a6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc62bd-2893-470d-9020-c3ba66049e62]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e684f3a-1dd9-4e2c-8e3b-98fddd47ea91]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dab30d-d77d-4fbb-be09-779d0a6462a4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eda3ed-5d01-4a92-9c0e-5ee9bf7c56ac]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43f6ea-002a-404e-8a65-1007216180a6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:38 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5258323-66ae-4a7f-8664-4ec21ca3665d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260]
Nov 18 15:42:39 user nova-compute[74839]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a05ce800-f75f-4068-bda2-e9d210c09642 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c42cc-089a-4e14-96bf-c4527eb0a9be]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] <== disconnect_volume: return (1580ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:42:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deleting instance files /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5_del
Nov 18 15:42:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deletion of /opt/stack/data/nova/instances/8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5_del complete
Nov 18 15:42:39 user nova-compute[74839]: INFO nova.compute.manager [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Took 2.79 seconds to destroy the instance on the hypervisor.
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:99:50:2c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-05194662-7faf-4418-a3a9-ed8dafc8c5cb tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.629s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:39 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:39 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Took 0.63 seconds to deallocate network for instance.
Nov 18 15:42:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:40 user nova-compute[74839]: INFO nova.compute.manager [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Took 0.75 seconds to detach 1 volumes for instance.
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Deleting volume: a05ce800-f75f-4068-bda2-e9d210c09642 {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:42:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance running successfully.
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] finish_revert_migration finished successfully. {{(pid=74839) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:40 user nova-compute[74839]: WARNING nova.compute.manager [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state resized and task_state resize_reverting.
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-253c2e8d-a99b-4e3b-924d-444621ea2f35 req-f667c64f-6e70-42be-82a0-33c1f5e68f1f service nova] [instance: 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5] Received event network-vif-deleted-a1af3151-b29a-4b46-b338-f436e2e89525 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:40 user nova-compute[74839]: INFO nova.compute.manager [None req-133706fb-6b2d-418f-813b-b0cf919a4543 tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance to original state: 'active'
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:42:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:41 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Deleted allocations for instance 8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3bee7b1b-1b53-417f-9f91-b341de55c594 tempest-ServerActionsV293TestJSON-205242596 tempest-ServerActionsV293TestJSON-205242596-project-member] Lock "8ad2e0e1-fd80-4e97-9e04-0fb819cfa6b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.808s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:41 user nova-compute[74839]: INFO nova.compute.manager [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Rebuilding instance
Nov 18 15:42:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-unplugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-unplugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:41 user nova-compute[74839]: WARNING nova.compute.manager [req-3018706c-2eea-4f14-a47a-074c2cdd2e57 req-d83d0b7e-193e-40b4-b1a4-f2a6cdf074d9 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-unplugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state active and task_state rebuilding.
Nov 18 15:42:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance destroyed successfully.
Nov 18 15:42:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:42 user nova-compute[74839]: INFO nova.compute.manager [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Detaching volume 03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [{"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:42 user nova-compute[74839]: INFO nova.virt.block_device [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attempting to driver detach volume 03079d99-30ab-419d-a333-cd7c355d8928 from mountpoint /dev/vdb
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Attempting to detach device vdb from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:42:42 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:42:42 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 15:42:42 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:42:42 user nova-compute[74839]:   <serial>03079d99-30ab-419d-a333-cd7c355d8928</serial>
Nov 18 15:42:42 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:42:42 user nova-compute[74839]: </disk>
Nov 18 15:42:42 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:42:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully detached device vdb from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the persistent domain config.
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:42 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d8d6f-7bcc-4a36-b3e3-58152c6b18fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:42:42 user nova-compute[74839]: No targets found.
Nov 18 15:42:42 user nova-compute[74839]: iSNS:
Nov 18 15:42:42 user nova-compute[74839]: No targets found.
Nov 18 15:42:42 user nova-compute[74839]: STATIC:
Nov 18 15:42:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:42:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:42:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:42 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:42:42 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:42 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:42 user nova-compute[74839]: FIRMWARE:
Nov 18 15:42:42 user nova-compute[74839]: No targets found.
Nov 18 15:42:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:42:42 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:42:42 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e735f4-7bdd-4fee-92e2-3efd1bcd641b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bbd497-0ba1-4def-8483-7e39ff57aeff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a017dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8972f43-8e8b-4266-9e95-6fce38a0a230]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d11cc5-5523-42e6-bec1-dc6cb49ed0da]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef65a457-3586-4d38-acf2-8d6b0661f7af]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f798029-820e-4125-96b6-e6fad58eb995]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7d3e7-5b21-4b21-9c56-c4c83765543f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5fc0f9-2bc0-425d-bba6-64f354feb4ae]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]
Nov 18 15:42:43 user nova-compute[74839]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51e655-e7f0-4b07-9b54-a7607d152ffa]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== disconnect_volume: return (367ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:44 user nova-compute[74839]: WARNING nova.compute.manager [req-7bff6ffb-8447-4795-87c6-6d226b3677f7 req-15572707-9141-4214-bd16-674ca09508db service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state active and task_state rebuilding.
Nov 18 15:42:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance destroyed successfully.
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-ServerActionsTestOtherA-server-796875608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap694ae7dc-c6, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74023017-3287-47cc-a85c-44700bfb5044) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:44 user nova-compute[74839]: INFO os_vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6')
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:44 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a0aa4-137d-43ce-924a-a3acfb2d05f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:42:44 user nova-compute[74839]: No targets found.
Nov 18 15:42:44 user nova-compute[74839]: iSNS:
Nov 18 15:42:44 user nova-compute[74839]: No targets found.
Nov 18 15:42:44 user nova-compute[74839]: STATIC:
Nov 18 15:42:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:42:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:44 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:42:44 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:42:44 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:42:44 user nova-compute[74839]: FIRMWARE:
Nov 18 15:42:44 user nova-compute[74839]: No targets found.
Nov 18 15:42:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:42:44 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:42:44 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a1b71-eef4-4332-956f-4923d0c0294f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caead39-abc0-4807-b41d-1f27770b47db]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:44 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:44 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801a4b80>, {}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Disconnecting from: [] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.134s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== disconnect_volume: return (135ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:42:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Deleting instance files /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad_del
Nov 18 15:42:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Deletion of /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad_del complete
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: INFO nova.virt.block_device [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Booting with volume 03079d99-30ab-419d-a333-cd7c355d8928 at /dev/vdb
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.utils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c27b8-9509-439c-b38c-11d9880d9196]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2d419-b0ae-4b7b-b414-d1a0d56f26c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6de2b-ad9b-4512-a34d-c409dd49f4b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588ad0e-80d4-4bde-9659-f2b3a464fe7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:42:44 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2970e9-00f2-42f1-87c2-977be4761d23]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG os_brick.utils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating existing volume attachment record: ca3a5e02-f361-4252-9c70-20b6c08d5de5 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'f34ad603-49e5-45a2-9089-a6373aa5e9ad' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f34ad603-49e5-45a2-9089-a6373aa5e9ad' (instance-00000019)
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7977MB free_disk=25.253387451171875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a802622d-75a4-4abd-b94c-fa2e54729b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:42:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:42:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:42:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Creating image(s)
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk 1073741824" returned: 0 in 0.059s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:42:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Cannot resize image /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Ensure instance console log exists: /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start _get_guest_xml network_info=[{"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'ca3a5e02-f361-4252-9c70-20b6c08d5de5', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f34ad603-49e5-45a2-9089-a6373aa5e9ad', 'attached_at': '', 'detached_at': '', 'volume_id': '03079d99-30ab-419d-a333-cd7c355d8928', 'serial': '03079d99-30ab-419d-a333-cd7c355d8928'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:42:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 15:42:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.objects.instance [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'vcpu_model' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:42:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:42:51 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9363de3-6b69-4bb3-be9a-0073ae551f1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:42:51 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[35afa455-f477-4aab-a879-f45efa79f53c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928] added
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc82ce-311a-4de1-8eef-a258f8d08dcf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99549e-9338-41fb-ac54-39c08b8291db]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLOsYtQh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLOsYtQh" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d65f7-0474-4e8e-8a80-50e207e85e19]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLOsYtQh'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf2a83-8491-4792-ab8c-abfc9658312f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd3843-1253-4823-81b6-f48874dbc6d7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6734c800-3feb-49fd-82a8-09e41cc41750]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]
Nov 18 15:42:51 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d043478-b293-4c15-8a42-4cde0026ba1b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[937e82dc-7033-438d-83b7-e902ca4859a8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:42:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d72e7d-72ab-4190-9ee6-976fe91832c4]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:42:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23064656631373931', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064656631373931', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-ServerActionsTestOtherA-server-796875608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:42:52 user nova-compute[74839]:   <uuid>f34ad603-49e5-45a2-9089-a6373aa5e9ad</uuid>
Nov 18 15:42:52 user nova-compute[74839]:   <name>instance-00000019</name>
Nov 18 15:42:52 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:42:52 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:42:52 user nova-compute[74839]:   <metadata>
Nov 18 15:42:52 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:42:52 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherA-server-796875608</nova:name>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:42:51</nova:creationTime>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:42:52 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:42:52 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:owner>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:user uuid="5789c3f8f97b4d58871c77cdd19b969a">tempest-ServerActionsTestOtherA-89343349-project-member</nova:user>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:project uuid="572badc0c30b4e3ba5b41b49cb2f8ed6">tempest-ServerActionsTestOtherA-89343349</nova:project>
Nov 18 15:42:52 user nova-compute[74839]:       </nova:owner>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:42:52 user nova-compute[74839]:       <nova:ports>
Nov 18 15:42:52 user nova-compute[74839]:         <nova:port uuid="694ae7dc-c6e9-4cd6-8141-4b0069246070">
Nov 18 15:42:52 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:42:52 user nova-compute[74839]:         </nova:port>
Nov 18 15:42:52 user nova-compute[74839]:       </nova:ports>
Nov 18 15:42:52 user nova-compute[74839]:     </nova:instance>
Nov 18 15:42:52 user nova-compute[74839]:   </metadata>
Nov 18 15:42:52 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:42:52 user nova-compute[74839]:     <system>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="serial">f34ad603-49e5-45a2-9089-a6373aa5e9ad</entry>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="uuid">f34ad603-49e5-45a2-9089-a6373aa5e9ad</entry>
Nov 18 15:42:52 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:42:52 user nova-compute[74839]:     </system>
Nov 18 15:42:52 user nova-compute[74839]:   </sysinfo>
Nov 18 15:42:52 user nova-compute[74839]:   <os>
Nov 18 15:42:52 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:42:52 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:42:52 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:42:52 user nova-compute[74839]:   </os>
Nov 18 15:42:52 user nova-compute[74839]:   <features>
Nov 18 15:42:52 user nova-compute[74839]:     <acpi/>
Nov 18 15:42:52 user nova-compute[74839]:     <apic/>
Nov 18 15:42:52 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:42:52 user nova-compute[74839]:   </features>
Nov 18 15:42:52 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:42:52 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:42:52 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:42:52 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:42:52 user nova-compute[74839]:   </clock>
Nov 18 15:42:52 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:42:52 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:42:52 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:42:52 user nova-compute[74839]:   </cpu>
Nov 18 15:42:52 user nova-compute[74839]:   <devices>
Nov 18 15:42:52 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:42:52 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:42:52 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk"/>
Nov 18 15:42:52 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:42:52 user nova-compute[74839]:     </disk>
Nov 18 15:42:52 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:42:52 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:42:52 user nova-compute[74839]:       <source dev="/dev/sdd"/>
Nov 18 15:42:52 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:42:52 user nova-compute[74839]:       <serial>03079d99-30ab-419d-a333-cd7c355d8928</serial>
Nov 18 15:42:52 user nova-compute[74839]:     </disk>
Nov 18 15:42:52 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:42:52 user nova-compute[74839]:       <mac address="fa:16:3e:99:50:2c"/>
Nov 18 15:42:52 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:52 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:42:52 user nova-compute[74839]:       <target dev="tap694ae7dc-c6"/>
Nov 18 15:42:52 user nova-compute[74839]:     </interface>
Nov 18 15:42:52 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:42:52 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/console.log" append="off"/>
Nov 18 15:42:52 user nova-compute[74839]:     </serial>
Nov 18 15:42:52 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:42:52 user nova-compute[74839]:     <video>
Nov 18 15:42:52 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:52 user nova-compute[74839]:     </video>
Nov 18 15:42:52 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:42:52 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:42:52 user nova-compute[74839]:     </rng>
Nov 18 15:42:52 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:42:52 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:42:52 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:42:52 user nova-compute[74839]:     </memballoon>
Nov 18 15:42:52 user nova-compute[74839]:   </devices>
Nov 18 15:42:52 user nova-compute[74839]: </domain>
Nov 18 15:42:52 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-ServerActionsTestOtherA-server-796875608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG os_vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c2c67af-a0b6-548e-a93d-15007ad217f1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap694ae7dc-c6, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap694ae7dc-c6, col_values=(('qos', UUID('22bb57bd-0179-450f-aa9a-a9d7fcce8fb1')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap694ae7dc-c6, col_values=(('external_ids', {'iface-id': '694ae7dc-c6e9-4cd6-8141-4b0069246070', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:50:2c', 'vm-uuid': 'f34ad603-49e5-45a2-9089-a6373aa5e9ad'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:52 user nova-compute[74839]: INFO os_vif [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6')
Nov 18 15:42:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:52 user nova-compute[74839]: INFO nova.compute.manager [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Unshelving
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:99:50:2c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_requests' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'numa_topology' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:42:52 user nova-compute[74839]: INFO nova.compute.claims [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Claim successful on node user
Nov 18 15:42:52 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:53 user nova-compute[74839]: INFO nova.network.neutron [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing instance network info cache due to event network-changed-34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] Acquiring lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:54 user nova-compute[74839]: WARNING nova.compute.manager [req-f11dbe39-1c00-40c0-9968-6185191b7942 req-2217cfbd-0e8d-423a-bd95-ff59f7236e14 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 15:42:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:42:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Creating image(s)
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'trusted_certs' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] Acquired lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Refreshing network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG nova.objects.base [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<693e326d-b414-425b-b318-6f57486154a2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.part --force-share --output=json" returned: 0 in 0.164s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG nova.virt.images [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] 76097c37-f108-4189-ab0e-33e76050de24 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:42:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.part /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updated VIF entry in instance network info cache for port 34c9c001-9d3b-40d9-a028-4af1c6d5cc49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.part /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.converted" returned: 0 in 0.350s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd5744de-35c9-499d-80eb-6f41aa23a55b req-d110892c-2c8f-4f3f-ac02-28e860df07c7 service nova] Releasing lock "refresh_cache-693e326d-b414-425b-b318-6f57486154a2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] No waiting events found dispatching network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:42:56 user nova-compute[74839]: WARNING nova.compute.manager [req-e5f313c8-034c-4f8b-bf00-3a51059ebd11 req-440d3eb8-33a0-41ca-a34d-58ff52119624 service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received unexpected event network-vif-plugged-694ae7dc-c6e9-4cd6-8141-4b0069246070 for instance with vm_state active and task_state rebuild_spawning.
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:42:56 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance spawned successfully.
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.731s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG nova.objects.instance [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74839) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-807371c8-b7ca-4e72-a6ba-3e2dd9f33028 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.116s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade,backing_fmt=raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade,backing_fmt=raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk 1073741824" returned: 0 in 0.144s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "21a510a82f6c25342367d2b6e07ba3f3b0e67ade" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'migration_context' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG nova.objects.base [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<693e326d-b414-425b-b318-6f57486154a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:42:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Rebasing disk image.
Nov 18 15:42:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 -F raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:42:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 -F raw /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk" returned: 0 in 2.313s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Ensure instance console log exists: /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start _get_guest_xml network_info=[{"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='86e50c65e73f996cd5dc2a73d9838097',container_format='bare',created_at=2023-11-18T15:41:00Z,direct_url=<?>,disk_format='qcow2',id=76097c37-f108-4189-ab0e-33e76050de24,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1895332168-shelved',owner='9bfa5a922984458fbccbdebc0a906763',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T15:41:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:42:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='86e50c65e73f996cd5dc2a73d9838097',container_format='bare',created_at=2023-11-18T15:41:00Z,direct_url=<?>,disk_format='qcow2',id=76097c37-f108-4189-ab0e-33e76050de24,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1895332168-shelved',owner='9bfa5a922984458fbccbdebc0a906763',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-18T15:41:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'vcpu_model' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.objects.base [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<693e326d-b414-425b-b318-6f57486154a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='76097c37-f108-4189-ab0e-33e76050de24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-864750464',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:41:05.270353',shelved_host='user',shelved_image_id='76097c37-f108-4189-ab0e-33e76050de24'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'pci_devices' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.objects.base [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Object Instance<693e326d-b414-425b-b318-6f57486154a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:42:59 user nova-compute[74839]:   <uuid>693e326d-b414-425b-b318-6f57486154a2</uuid>
Nov 18 15:42:59 user nova-compute[74839]:   <name>instance-00000014</name>
Nov 18 15:42:59 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:42:59 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:42:59 user nova-compute[74839]:   <metadata>
Nov 18 15:42:59 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:42:59 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1895332168</nova:name>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:42:59</nova:creationTime>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:42:59 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:42:59 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:owner>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:user uuid="7acc8cec037e4e0081c72125cc4c6db9">tempest-AttachVolumeShelveTestJSON-619260582-project-member</nova:user>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:project uuid="9bfa5a922984458fbccbdebc0a906763">tempest-AttachVolumeShelveTestJSON-619260582</nova:project>
Nov 18 15:42:59 user nova-compute[74839]:       </nova:owner>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:root type="image" uuid="76097c37-f108-4189-ab0e-33e76050de24"/>
Nov 18 15:42:59 user nova-compute[74839]:       <nova:ports>
Nov 18 15:42:59 user nova-compute[74839]:         <nova:port uuid="34c9c001-9d3b-40d9-a028-4af1c6d5cc49">
Nov 18 15:42:59 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 18 15:42:59 user nova-compute[74839]:         </nova:port>
Nov 18 15:42:59 user nova-compute[74839]:       </nova:ports>
Nov 18 15:42:59 user nova-compute[74839]:     </nova:instance>
Nov 18 15:42:59 user nova-compute[74839]:   </metadata>
Nov 18 15:42:59 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:42:59 user nova-compute[74839]:     <system>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="serial">693e326d-b414-425b-b318-6f57486154a2</entry>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="uuid">693e326d-b414-425b-b318-6f57486154a2</entry>
Nov 18 15:42:59 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:42:59 user nova-compute[74839]:     </system>
Nov 18 15:42:59 user nova-compute[74839]:   </sysinfo>
Nov 18 15:42:59 user nova-compute[74839]:   <os>
Nov 18 15:42:59 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:42:59 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:42:59 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:42:59 user nova-compute[74839]:   </os>
Nov 18 15:42:59 user nova-compute[74839]:   <features>
Nov 18 15:42:59 user nova-compute[74839]:     <acpi/>
Nov 18 15:42:59 user nova-compute[74839]:     <apic/>
Nov 18 15:42:59 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:42:59 user nova-compute[74839]:   </features>
Nov 18 15:42:59 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:42:59 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:42:59 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:42:59 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:42:59 user nova-compute[74839]:   </clock>
Nov 18 15:42:59 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:42:59 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:42:59 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:42:59 user nova-compute[74839]:   </cpu>
Nov 18 15:42:59 user nova-compute[74839]:   <devices>
Nov 18 15:42:59 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:42:59 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:42:59 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk"/>
Nov 18 15:42:59 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:42:59 user nova-compute[74839]:     </disk>
Nov 18 15:42:59 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:42:59 user nova-compute[74839]:       <mac address="fa:16:3e:e8:4b:72"/>
Nov 18 15:42:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:59 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:42:59 user nova-compute[74839]:       <target dev="tap34c9c001-9d"/>
Nov 18 15:42:59 user nova-compute[74839]:     </interface>
Nov 18 15:42:59 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:42:59 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/console.log" append="off"/>
Nov 18 15:42:59 user nova-compute[74839]:     </serial>
Nov 18 15:42:59 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:42:59 user nova-compute[74839]:     <video>
Nov 18 15:42:59 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:42:59 user nova-compute[74839]:     </video>
Nov 18 15:42:59 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:42:59 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:42:59 user nova-compute[74839]:     </rng>
Nov 18 15:42:59 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:42:59 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:42:59 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:42:59 user nova-compute[74839]:     </memballoon>
Nov 18 15:42:59 user nova-compute[74839]:   </devices>
Nov 18 15:42:59 user nova-compute[74839]: </domain>
Nov 18 15:42:59 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='76097c37-f108-4189-ab0e-33e76050de24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-864750464',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member',shelved_at='2023-11-18T15:41:05.270353',shelved_host='user',shelved_image_id='76097c37-f108-4189-ab0e-33e76050de24'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG os_vif [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f29f38e-5d70-5e15-b6b8-da185b400b5f', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34c9c001-9d, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34c9c001-9d, col_values=(('qos', UUID('eb898c3e-3936-4509-a028-ec8720d6a141')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34c9c001-9d, col_values=(('external_ids', {'iface-id': '34c9c001-9d3b-40d9-a028-4af1c6d5cc49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:4b:72', 'vm-uuid': '693e326d-b414-425b-b318-6f57486154a2'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:42:59 user nova-compute[74839]: INFO os_vif [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d')
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:42:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] No VIF found with MAC fa:16:3e:e8:4b:72, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:43:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:01 user nova-compute[74839]: WARNING nova.compute.manager [req-5e0fcd53-2cf3-41af-8aed-bc5cce0310a9 req-392ce5d2-0e2e-4512-905a-f32da7c685c0 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:43:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance spawned successfully.
Nov 18 15:43:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:03 user nova-compute[74839]: WARNING nova.compute.manager [req-b9127838-f52a-462d-91ee-cabdfe612485 req-fc3da671-5bd4-4779-9aeb-6b65dc24ab46 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:43:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:43:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb1932a4-02f8-4f71-8786-73c05efb0850 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.208s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:05 user nova-compute[74839]: INFO nova.compute.manager [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Unshelving
Nov 18 15:43:06 user nova-compute[74839]: INFO nova.virt.block_device [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Booting with volume 9a32176d-b2f5-4758-861a-ef71a0deb3cb at /dev/vda
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.utils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b626b6d-5c7c-4f81-a88a-da0692374809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bf863f-9ca3-4a45-adf8-76a5abbe676a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ddfdb-c694-4035-bde8-8e594de0e02d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[954bbe5c-1b27-472a-af8c-347aff7eae4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:06 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:43:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[674637e0-5413-49fc-9a78-cb20d490063b]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG os_brick.utils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:06 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating existing volume attachment record: 5e4c9f32-8960-4a43-9cae-b73a64b3b359 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:43:07 user nova-compute[74839]: INFO nova.compute.claims [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Claim successful on node user
Nov 18 15:43:07 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:43:07 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:43:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:43:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.policy [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1b86e5899c041e88609206af0613940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0b5e1598374e26b3b0c081e6ca38d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:43:08 user nova-compute[74839]: INFO nova.virt.block_device [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Booting with volume-backed-image e059a7e6-6151-4faa-8cc1-55745cc1f78a at /dev/vda
Nov 18 15:43:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Successfully created port: 5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Successfully updated port: 5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-changed-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Refreshing instance network info cache due to event network-changed-5492bcba-54cf-4e9c-9773-25d45b6a0a1a. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] Acquiring lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance network_info: |[{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] Acquired lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:09 user nova-compute[74839]: DEBUG nova.network.neutron [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Refreshing network info cache for port 5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:43:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updated VIF entry in instance network info cache for port 5492bcba-54cf-4e9c-9773-25d45b6a0a1a. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:43:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5a8cb721-ca84-4009-bddf-27f879b1fa50 req-0194677e-18d2-440f-bbb7-33835d2d6c06 service nova] Releasing lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG nova.objects.instance [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'pci_requests' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG nova.objects.instance [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'numa_topology' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:43:14 user nova-compute[74839]: INFO nova.compute.claims [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Claim successful on node user
Nov 18 15:43:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:43:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:14 user nova-compute[74839]: INFO nova.network.neutron [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating port 0c211e29-d8bc-42e5-bfde-9ddd13447595 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing instance network info cache due to event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:43:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Creating image(s)
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Ensure instance console log exists: /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start _get_guest_xml network_info=[{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '5e4c9f32-8960-4a43-9cae-b73a64b3b359', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4496a0ec-d5c5-499a-8e93-0cbefac56fca', 'attached_at': '', 'detached_at': '', 'volume_id': '9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'serial': '9a32176d-b2f5-4758-861a-ef71a0deb3cb'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:43:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.objects.instance [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.objects.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Object Instance<4496a0ec-d5c5-499a-8e93-0cbefac56fca> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:15 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:15 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:15 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ead1e75-e5c0-4370-855b-1e67977e1d6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:43:15 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0474eca-1601-4ba0-9895-9d7cb81fbaac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb] added
Nov 18 15:43:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4960149-994f-4679-b5e6-91c8de6b9ce4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c72784f-a247-41cd-b78f-4db8b2a57ddc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psPecaBQ {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psPecaBQ" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[04303474-2392-4174-bbde-58cc973e34f0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psPecaBQ'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2576253-1579-4637-b931-6e3c87ab5044]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508d790-78dd-4432-8f93-146c50b84a7c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef1bf4-c70c-47cc-b1da-bc26652a76ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]
Nov 18 15:43:16 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.
Nov 18 15:43:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7bd174-af9e-4b29-a723-bc25efafb188]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77180386-00a7-4807-9f36-a7a3886d4f76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:16 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:16 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updated VIF entry in instance network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eed7b9-d4ba-47e5-a012-e1e7b7687f85]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:43:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b0011b87-a464-4f71-8ae7-86e97864a9a1 req-45a0e189-718a-4f7b-9e93-eaa6fd6370bc service nova] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26665396338363665', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665396338363665', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1435268891',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:43:06Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.objects.instance [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'pci_devices' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.objects.base [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Object Instance<4496a0ec-d5c5-499a-8e93-0cbefac56fca> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:43:17 user nova-compute[74839]:   <uuid>4496a0ec-d5c5-499a-8e93-0cbefac56fca</uuid>
Nov 18 15:43:17 user nova-compute[74839]:   <name>instance-00000015</name>
Nov 18 15:43:17 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:43:17 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:43:17 user nova-compute[74839]:   <metadata>
Nov 18 15:43:17 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:43:17 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:43:17 user nova-compute[74839]:       <nova:name>tempest-TestShelveInstance-server-287785288</nova:name>
Nov 18 15:43:17 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:43:15</nova:creationTime>
Nov 18 15:43:17 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:43:17 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:43:17 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:43:17 user nova-compute[74839]:       <nova:owner>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:user uuid="9b3b23664b394fae9ce3bb99461fe9e2">tempest-TestShelveInstance-284363904-project-member</nova:user>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:project uuid="0791e06caa2f4df2b8415d8014888775">tempest-TestShelveInstance-284363904</nova:project>
Nov 18 15:43:17 user nova-compute[74839]:       </nova:owner>
Nov 18 15:43:17 user nova-compute[74839]:       <nova:ports>
Nov 18 15:43:17 user nova-compute[74839]:         <nova:port uuid="0c211e29-d8bc-42e5-bfde-9ddd13447595">
Nov 18 15:43:17 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 15:43:17 user nova-compute[74839]:         </nova:port>
Nov 18 15:43:17 user nova-compute[74839]:       </nova:ports>
Nov 18 15:43:17 user nova-compute[74839]:     </nova:instance>
Nov 18 15:43:17 user nova-compute[74839]:   </metadata>
Nov 18 15:43:17 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:43:17 user nova-compute[74839]:     <system>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="serial">4496a0ec-d5c5-499a-8e93-0cbefac56fca</entry>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="uuid">4496a0ec-d5c5-499a-8e93-0cbefac56fca</entry>
Nov 18 15:43:17 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:43:17 user nova-compute[74839]:     </system>
Nov 18 15:43:17 user nova-compute[74839]:   </sysinfo>
Nov 18 15:43:17 user nova-compute[74839]:   <os>
Nov 18 15:43:17 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:43:17 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:43:17 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:43:17 user nova-compute[74839]:   </os>
Nov 18 15:43:17 user nova-compute[74839]:   <features>
Nov 18 15:43:17 user nova-compute[74839]:     <acpi/>
Nov 18 15:43:17 user nova-compute[74839]:     <apic/>
Nov 18 15:43:17 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:43:17 user nova-compute[74839]:   </features>
Nov 18 15:43:17 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:43:17 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:43:17 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:43:17 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:43:17 user nova-compute[74839]:   </clock>
Nov 18 15:43:17 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:43:17 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:43:17 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:43:17 user nova-compute[74839]:   </cpu>
Nov 18 15:43:17 user nova-compute[74839]:   <devices>
Nov 18 15:43:17 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:43:17 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:43:17 user nova-compute[74839]:       <source dev="/dev/sde"/>
Nov 18 15:43:17 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:43:17 user nova-compute[74839]:       <serial>9a32176d-b2f5-4758-861a-ef71a0deb3cb</serial>
Nov 18 15:43:17 user nova-compute[74839]:     </disk>
Nov 18 15:43:17 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:43:17 user nova-compute[74839]:       <mac address="fa:16:3e:13:6a:43"/>
Nov 18 15:43:17 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:43:17 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:43:17 user nova-compute[74839]:       <target dev="tap0c211e29-d8"/>
Nov 18 15:43:17 user nova-compute[74839]:     </interface>
Nov 18 15:43:17 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:43:17 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca/console.log" append="off"/>
Nov 18 15:43:17 user nova-compute[74839]:     </serial>
Nov 18 15:43:17 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:43:17 user nova-compute[74839]:     <video>
Nov 18 15:43:17 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:43:17 user nova-compute[74839]:     </video>
Nov 18 15:43:17 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:43:17 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:43:17 user nova-compute[74839]:     </rng>
Nov 18 15:43:17 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:43:17 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:43:17 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:43:17 user nova-compute[74839]:     </memballoon>
Nov 18 15:43:17 user nova-compute[74839]:   </devices>
Nov 18 15:43:17 user nova-compute[74839]: </domain>
Nov 18 15:43:17 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1435268891',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:43:06Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG os_vif [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3844878b-889f-5339-ae3d-59442720d0f6', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c211e29-d8, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c211e29-d8, col_values=(('qos', UUID('ccc0015e-2c87-494c-9f22-1adf41049a80')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c211e29-d8, col_values=(('external_ids', {'iface-id': '0c211e29-d8bc-42e5-bfde-9ddd13447595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:6a:43', 'vm-uuid': '4496a0ec-d5c5-499a-8e93-0cbefac56fca'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:17 user nova-compute[74839]: INFO os_vif [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8')
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:43:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] No VIF found with MAC fa:16:3e:13:6a:43, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:18 user nova-compute[74839]: WARNING nova.compute.manager [req-8b0624eb-1792-4518-a5dd-8211941541e9 req-4e385dd0-ff90-418d-8de9-27949ad1848f service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:43:18 user nova-compute[74839]: DEBUG os_brick.utils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79b64a-2765-4201-b95f-fcac6922225a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472f630-9f1d-4220-ae77-7ec455ce604d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb4f9c-b07e-45e5-b6a5-e30ab0873363]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d217b-2a41-431a-8cf4-b903ca64fedd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:19 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:43:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a853a9e0-eb31-4b8b-ba31-512a2483fcac]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG os_brick.utils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating existing volume attachment record: f4f644dd-3b90-4cfa-bf1d-bebd7d17c5fb {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:20 user nova-compute[74839]: WARNING nova.compute.manager [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-changed-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Refreshing instance network info cache due to event network-changed-33039476-4a28-44ae-9841-7ae950ba7b49. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Acquiring lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Acquired lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.network.neutron [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Refreshing network info cache for port 33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:43:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance spawned successfully.
Nov 18 15:43:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:43:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-291500c5-f916-4908-a16b-b078c8e439bd tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.942s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:21 user nova-compute[74839]: DEBUG nova.network.neutron [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updated VIF entry in instance network info cache for port 33039476-4a28-44ae-9841-7ae950ba7b49. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:43:21 user nova-compute[74839]: DEBUG nova.network.neutron [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating instance_info_cache with network_info: [{"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f3c63a83-b757-4b2c-8972-67a47f3c923d req-d3187e69-b920-4d50-91ae-4136bdd45269 service nova] Releasing lock "refresh_cache-a802622d-75a4-4abd-b94c-fa2e54729b91" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:22 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:23 user nova-compute[74839]: INFO nova.compute.manager [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Attaching volume 2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 to /dev/vdb
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.utils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a93f79-fbdc-45a4-9907-c4286229d5d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e0ef0-3f7e-4dfd-8f4b-d8d8737a30fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bbea52-5fe0-47a7-bfd6-db0adc58cb06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77363d98-9e2e-4f10-b73c-63629b6183a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:43:23 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:43:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb3bf7-2ac3-494c-8e05-4df3d76cce0f]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG os_brick.utils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:23 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating existing volume attachment record: 9d23b598-cf30-4c01-8267-57643811f48b {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:43:25 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Creating image(s)
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Ensure instance console log exists: /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start _get_guest_xml network_info=[{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f4f644dd-3b90-4cfa-bf1d-bebd7d17c5fb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24fe45b3-613e-482d-988e-f72d865571b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'serial': 'ee3d83f7-9f93-41a4-9a8d-323ae4c0692a'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:43:25 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:25 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:25 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:25 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:25 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebab94-61f7-4e8c-9984-e5d3ee2484e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:43:25 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26419cc8-ea26-4754-adbe-8310b9f1b0fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a] added
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c87e2-66f5-430f-89da-a20195dd73e4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97c768-6d65-4806-a3b7-d11d89ad7094]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtoWBELD {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtoWBELD" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9ef4b-0f34-42c9-b57c-6d606d764dbd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XtoWBELD'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eccd175-3577-4a4e-a07a-829f5eba676d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b9570b-b4a9-44d7-87b4-f2a9302003d5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[406aae09-0541-4bad-a318-bf2242ae0938]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260]
Nov 18 15:43:25 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260] successful.
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761908f-c19a-42c9-aaf0-5e56d47db03e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f136607f-66fa-4e2c-b2f3-2e865ae9727a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:25 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8f88a-63e7-4aae-8d21-afafbd8a9b57]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:43:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26237623236373835', 'path': '/dev/sdf'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623236373835', 'path': '/dev/sdf'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347918971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347918971',id=27,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-dl1f2mh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:43:08Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=24fe45b3-613e-482d-988e-f72d865571b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:43:26 user nova-compute[74839]:   <uuid>24fe45b3-613e-482d-988e-f72d865571b8</uuid>
Nov 18 15:43:26 user nova-compute[74839]:   <name>instance-0000001b</name>
Nov 18 15:43:26 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:43:26 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:43:26 user nova-compute[74839]:   <metadata>
Nov 18 15:43:26 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:43:26 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-347918971</nova:name>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:43:25</nova:creationTime>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:43:26 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:43:26 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:owner>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:43:26 user nova-compute[74839]:       </nova:owner>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:43:26 user nova-compute[74839]:       <nova:ports>
Nov 18 15:43:26 user nova-compute[74839]:         <nova:port uuid="5492bcba-54cf-4e9c-9773-25d45b6a0a1a">
Nov 18 15:43:26 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:43:26 user nova-compute[74839]:         </nova:port>
Nov 18 15:43:26 user nova-compute[74839]:       </nova:ports>
Nov 18 15:43:26 user nova-compute[74839]:     </nova:instance>
Nov 18 15:43:26 user nova-compute[74839]:   </metadata>
Nov 18 15:43:26 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:43:26 user nova-compute[74839]:     <system>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="serial">24fe45b3-613e-482d-988e-f72d865571b8</entry>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="uuid">24fe45b3-613e-482d-988e-f72d865571b8</entry>
Nov 18 15:43:26 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:43:26 user nova-compute[74839]:     </system>
Nov 18 15:43:26 user nova-compute[74839]:   </sysinfo>
Nov 18 15:43:26 user nova-compute[74839]:   <os>
Nov 18 15:43:26 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:43:26 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:43:26 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:43:26 user nova-compute[74839]:   </os>
Nov 18 15:43:26 user nova-compute[74839]:   <features>
Nov 18 15:43:26 user nova-compute[74839]:     <acpi/>
Nov 18 15:43:26 user nova-compute[74839]:     <apic/>
Nov 18 15:43:26 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:43:26 user nova-compute[74839]:   </features>
Nov 18 15:43:26 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:43:26 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:43:26 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:43:26 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:43:26 user nova-compute[74839]:   </clock>
Nov 18 15:43:26 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:43:26 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:43:26 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:43:26 user nova-compute[74839]:   </cpu>
Nov 18 15:43:26 user nova-compute[74839]:   <devices>
Nov 18 15:43:26 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:43:26 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:43:26 user nova-compute[74839]:       <source dev="/dev/sdf"/>
Nov 18 15:43:26 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:43:26 user nova-compute[74839]:       <serial>ee3d83f7-9f93-41a4-9a8d-323ae4c0692a</serial>
Nov 18 15:43:26 user nova-compute[74839]:     </disk>
Nov 18 15:43:26 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:43:26 user nova-compute[74839]:       <mac address="fa:16:3e:2a:3a:3a"/>
Nov 18 15:43:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:43:26 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:43:26 user nova-compute[74839]:       <target dev="tap5492bcba-54"/>
Nov 18 15:43:26 user nova-compute[74839]:     </interface>
Nov 18 15:43:26 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:43:26 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/console.log" append="off"/>
Nov 18 15:43:26 user nova-compute[74839]:     </serial>
Nov 18 15:43:26 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:43:26 user nova-compute[74839]:     <video>
Nov 18 15:43:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:43:26 user nova-compute[74839]:     </video>
Nov 18 15:43:26 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:43:26 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:43:26 user nova-compute[74839]:     </rng>
Nov 18 15:43:26 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:43:26 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:43:26 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:43:26 user nova-compute[74839]:     </memballoon>
Nov 18 15:43:26 user nova-compute[74839]:   </devices>
Nov 18 15:43:26 user nova-compute[74839]: </domain>
Nov 18 15:43:26 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347918971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347918971',id=27,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-dl1f2mh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:43:08Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=24fe45b3-613e-482d-988e-f72d865571b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG os_vif [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02ebcfad-e4ce-5283-ac14-3e9cb1131729', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5492bcba-54, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5492bcba-54, col_values=(('qos', UUID('a028e855-f597-4a02-8d12-65449090f16b')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5492bcba-54, col_values=(('external_ids', {'iface-id': '5492bcba-54cf-4e9c-9773-25d45b6a0a1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:3a:3a', 'vm-uuid': '24fe45b3-613e-482d-988e-f72d865571b8'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:26 user nova-compute[74839]: INFO os_vif [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54')
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:43:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:2a:3a:3a, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:28 user nova-compute[74839]: WARNING nova.compute.manager [req-988cfc9c-0b1f-4a06-9493-43782fcdbac1 req-8f14c076-2f6d-4eaa-a6e8-31dbd1b0b52a service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state building and task_state spawning.
Nov 18 15:43:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFQMcoZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:29 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:29 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:29 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665c0df-aabd-4628-93ef-c47bd6c30c46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:43:29 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2155e69-a762-4c6d-9d16-e4fb7221c60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9] added
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbeb32d-fd54-4b67-8137-c89d2d932ff1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6801052-ddb4-425a-b51e-7b115ebfe1eb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFQMcoZD {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFQMcoZD" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2e768f-612e-428b-b557-4f771ade847d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFQMcoZD'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fae06dd-b892-45f1-9566-849ef39a2415]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c3ba40-fa13-4c85-a6d2-0080426404b5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6794f-5fbc-4430-aff4-59882434033d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260]
Nov 18 15:43:29 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260] successful.
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0ccfca-ec12-454d-beb9-c294075febab]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e483e36-6d40-4fd2-9103-b2f068fb88aa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:29 user nova-compute[74839]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)
Nov 18 15:43:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ef17f-70b4-4179-9172-e73644ea6154]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:43:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:43:30 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance spawned successfully.
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:43:30 user nova-compute[74839]: INFO nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:30 user nova-compute[74839]: INFO nova.compute.manager [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Took 23.12 seconds to build instance.
Nov 18 15:43:30 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFQMcoZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23462666139313037', 'path': '/dev/sdg'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462666139313037', 'path': '/dev/sdg'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6e0cec97-92aa-49a5-8a0f-65208849e26b tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.248s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:43:30 user nova-compute[74839]: WARNING nova.compute.manager [req-ca05a8c8-c897-45e6-9bed-a68f3967991f req-307257cd-c598-436e-91db-be2409a63658 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state None.
Nov 18 15:43:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:43:30 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:43:30 user nova-compute[74839]:   <source dev="/dev/sdg"/>
Nov 18 15:43:30 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:43:30 user nova-compute[74839]:   <serial>2c6d2e12-6676-42b6-92cb-2e6a3a2adea9</serial>
Nov 18 15:43:30 user nova-compute[74839]: </disk>
Nov 18 15:43:30 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:43:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:43:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:43:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:a7:58:4e, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:43:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b93566d6-6e64-456d-9d06-9a056acfb7f1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.189s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:32 user nova-compute[74839]: INFO nova.compute.manager [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Detaching volume 2c6d2e12-6676-42b6-92cb-2e6a3a2adea9
Nov 18 15:43:32 user nova-compute[74839]: INFO nova.virt.block_device [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Attempting to driver detach volume 2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 from mountpoint /dev/vdb
Nov 18 15:43:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Attempting to detach device vdb from instance a802622d-75a4-4abd-b94c-fa2e54729b91 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:43:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:43:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:43:32 user nova-compute[74839]:   <source dev="/dev/sdg"/>
Nov 18 15:43:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:43:32 user nova-compute[74839]:   <serial>2c6d2e12-6676-42b6-92cb-2e6a3a2adea9</serial>
Nov 18 15:43:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:43:32 user nova-compute[74839]: </disk>
Nov 18 15:43:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:43:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance a802622d-75a4-4abd-b94c-fa2e54729b91 from the persistent domain config.
Nov 18 15:43:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a802622d-75a4-4abd-b94c-fa2e54729b91 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:43:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:43:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:43:32 user nova-compute[74839]:   <source dev="/dev/sdg"/>
Nov 18 15:43:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:43:32 user nova-compute[74839]:   <serial>2c6d2e12-6676-42b6-92cb-2e6a3a2adea9</serial>
Nov 18 15:43:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:43:32 user nova-compute[74839]: </disk>
Nov 18 15:43:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:43:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:43:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [{"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-33c2ac3e-6465-4d42-8cf8-15432abc1b53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:42 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:43:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7401MB free_disk=25.2149658203125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a802622d-75a4-4abd-b94c-fa2e54729b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 693e326d-b414-425b-b318-6f57486154a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 24fe45b3-613e-482d-988e-f72d865571b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:43:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:43:48 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:43:48 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:43:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:43:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:43:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:43:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:52 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a802622d-75a4-4abd-b94c-fa2e54729b91 is timed out.
Nov 18 15:43:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance a802622d-75a4-4abd-b94c-fa2e54729b91 from the live domain config.
Nov 18 15:43:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFQMcoZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:43:52 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f4c35f-7263-45b6-a54d-40308d5ac5ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:43:52 user nova-compute[74839]: No targets found.
Nov 18 15:43:52 user nova-compute[74839]: iSNS:
Nov 18 15:43:52 user nova-compute[74839]: No targets found.
Nov 18 15:43:52 user nova-compute[74839]: STATIC:
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:43:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:43:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:43:52 user nova-compute[74839]: FIRMWARE:
Nov 18 15:43:52 user nova-compute[74839]: No targets found.
Nov 18 15:43:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:43:52 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:43:52 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13040c90-e9fd-423a-b2d7-f1d883674bdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cedc288-b797-483b-bb9c-87c03b6599ab]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:43:52 user nova-compute[74839]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 (non-flash)
Nov 18 15:43:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801ebe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9'): ({'sdg'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Removing single pathed devices sdg {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5497ee6-8a4a-4bd5-8471-d0ca40e265cf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2cfe77-aa34-4098-93b0-67af27c8914a]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flushing IO for device /dev/sdg {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab47f6-ed27-4401-a658-5ba59f0812bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e0e282-4ac4-4194-a622-f6c530c8ab16]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] SCSI volumes sdg have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb3cc8b-d046-45a3-89e0-5293ad3883f7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5273c000-5c7b-46d8-90e4-98edeb56d0bd]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260]
Nov 18 15:43:52 user nova-compute[74839]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9, portal: 172.16.0.220,3260] successful.
Nov 18 15:43:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6d2e12-6676-42b6-92cb-2e6a3a2adea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527d26f-24b7-4de1-a94f-cb22d521e819]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== disconnect_volume: return (324ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:43:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8f60126e-0264-4ee4-a160-339efcd20d1c tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.639s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:43:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:43:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:44:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:22 user nova-compute[74839]: INFO nova.compute.manager [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Terminating instance
Nov 18 15:44:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-unplugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] No waiting events found dispatching network-vif-unplugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-4ff97d0b-8621-4aa4-9ab7-6fbdc1c917f0 req-32e78489-7c5b-4ba0-b61c-3341f8dc65dd service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-unplugged-33039476-4a28-44ae-9841-7ae950ba7b49 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:44:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Instance destroyed successfully.
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'resources' on Instance uuid a802622d-75a4-4abd-b94c-fa2e54729b91 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:41:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1062096145',display_name='tempest-AttachVolumeNegativeTest-server-1062096145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1062096145',id=26,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFtSNLtJjGZEt60lPzopSpOSWJIe03oJtvcRTAcuMll0SA8nKHMEAsKnzyaoLAhzvSUctrV35cFuEKPOHJinct6/XBNBrxM9ovvSU76mDdwiAOhe/GzJCn1f3LvGPLWzw==',key_name='tempest-keypair-2020223622',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:41:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-3w33fv9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=a802622d-75a4-4abd-b94c-fa2e54729b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "33039476-4a28-44ae-9841-7ae950ba7b49", "address": "fa:16:3e:a7:58:4e", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33039476-4a", "ovs_interfaceid": "33039476-4a28-44ae-9841-7ae950ba7b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG os_vif [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33039476-4a, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=357281a2-e753-4008-86bf-730f76f490d3) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:23 user nova-compute[74839]: INFO os_vif [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:58:4e,bridge_name='br-int',has_traffic_filtering=True,id=33039476-4a28-44ae-9841-7ae950ba7b49,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33039476-4a')
Nov 18 15:44:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Deleting instance files /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91_del
Nov 18 15:44:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Deletion of /opt/stack/data/nova/instances/a802622d-75a4-4abd-b94c-fa2e54729b91_del complete
Nov 18 15:44:23 user nova-compute[74839]: INFO nova.compute.manager [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 18 15:44:23 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:44:23 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:24 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Took 0.77 seconds to deallocate network for instance.
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-13f6e8dc-6ac0-4bac-8bc9-40d6893ee346 req-ff97a7e6-a6d6-4596-b268-8ff74959ce26 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-deleted-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:24 user nova-compute[74839]: INFO nova.compute.manager [req-13f6e8dc-6ac0-4bac-8bc9-40d6893ee346 req-ff97a7e6-a6d6-4596-b268-8ff74959ce26 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Neutron deleted interface 33039476-4a28-44ae-9841-7ae950ba7b49; detaching it from the instance and deleting it from the info cache
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.network.neutron [req-13f6e8dc-6ac0-4bac-8bc9-40d6893ee346 req-ff97a7e6-a6d6-4596-b268-8ff74959ce26 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-13f6e8dc-6ac0-4bac-8bc9-40d6893ee346 req-ff97a7e6-a6d6-4596-b268-8ff74959ce26 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Detach interface failed, port_id=33039476-4a28-44ae-9841-7ae950ba7b49, reason: Instance a802622d-75a4-4abd-b94c-fa2e54729b91 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:44:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:25 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Deleted allocations for instance a802622d-75a4-4abd-b94c-fa2e54729b91
Nov 18 15:44:25 user nova-compute[74839]: DEBUG nova.compute.manager [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] Acquiring lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG nova.compute.manager [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] No waiting events found dispatching network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:25 user nova-compute[74839]: WARNING nova.compute.manager [req-ad8a4693-ccf3-4f69-9cdb-404bb9a18d16 req-7f5b03f3-78bf-458b-84d6-bcc033a73de0 service nova] [instance: a802622d-75a4-4abd-b94c-fa2e54729b91] Received unexpected event network-vif-plugged-33039476-4a28-44ae-9841-7ae950ba7b49 for instance with vm_state deleted and task_state None.
Nov 18 15:44:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe9af6cb-4304-485a-8248-d3b350ddfbe3 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "a802622d-75a4-4abd-b94c-fa2e54729b91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:44:33 user nova-compute[74839]: INFO nova.compute.claims [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Claim successful on node user
Nov 18 15:44:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:44:34 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.policy [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa275451859e4d35a4c7f5fcd7f48bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79791998433644babc3a23a9bcc83b32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:44:34 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Creating image(s)
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "/opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "/opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.165s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk 1073741824" returned: 0 in 0.052s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Successfully created port: 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Cannot resize image /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Ensure instance console log exists: /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Successfully updated port: 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquired lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-changed-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Refreshing instance network info cache due to event network-changed-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] Acquiring lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating instance_info_cache with network_info: [{"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Releasing lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Instance network_info: |[{"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] Acquired lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Refreshing network info cache for port 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Start _get_guest_xml network_info=[{"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:44:35 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:35 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546014982',display_name='tempest-TestServerVolumeAttachmentScenario-server-546014982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546014982',id=28,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0lJ1srp9V3uxk4LyjvlTpM2MosPN9ZBwQEtNoi1FwbWFhs0uLnjliIxR4XRCs4acT9/+XG8CZ8axFDlRIcY7MquJlYuuMLteiaN2FRLk0HnGBv2siH4YE1amRhyk/qw==',key_name='tempest-keypair-257006294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79791998433644babc3a23a9bcc83b32',ramdisk_id='',reservation_id='r-za1hsiiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1596425973',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1596425973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa275451859e4d35a4c7f5fcd7f48bbd',uuid=6fe9d3d8-f17e-447d-9d7f-d215b45f4a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converting VIF {"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.objects.instance [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:44:35 user nova-compute[74839]:   <uuid>6fe9d3d8-f17e-447d-9d7f-d215b45f4a53</uuid>
Nov 18 15:44:35 user nova-compute[74839]:   <name>instance-0000001c</name>
Nov 18 15:44:35 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:44:35 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:44:35 user nova-compute[74839]:   <metadata>
Nov 18 15:44:35 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:44:35 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-546014982</nova:name>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:44:35</nova:creationTime>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:44:35 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:44:35 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:owner>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:user uuid="fa275451859e4d35a4c7f5fcd7f48bbd">tempest-TestServerVolumeAttachmentScenario-1596425973-project-member</nova:user>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:project uuid="79791998433644babc3a23a9bcc83b32">tempest-TestServerVolumeAttachmentScenario-1596425973</nova:project>
Nov 18 15:44:35 user nova-compute[74839]:       </nova:owner>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:44:35 user nova-compute[74839]:       <nova:ports>
Nov 18 15:44:35 user nova-compute[74839]:         <nova:port uuid="5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3">
Nov 18 15:44:35 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 18 15:44:35 user nova-compute[74839]:         </nova:port>
Nov 18 15:44:35 user nova-compute[74839]:       </nova:ports>
Nov 18 15:44:35 user nova-compute[74839]:     </nova:instance>
Nov 18 15:44:35 user nova-compute[74839]:   </metadata>
Nov 18 15:44:35 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:44:35 user nova-compute[74839]:     <system>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="serial">6fe9d3d8-f17e-447d-9d7f-d215b45f4a53</entry>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="uuid">6fe9d3d8-f17e-447d-9d7f-d215b45f4a53</entry>
Nov 18 15:44:35 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:44:35 user nova-compute[74839]:     </system>
Nov 18 15:44:35 user nova-compute[74839]:   </sysinfo>
Nov 18 15:44:35 user nova-compute[74839]:   <os>
Nov 18 15:44:35 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:44:35 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:44:35 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:44:35 user nova-compute[74839]:   </os>
Nov 18 15:44:35 user nova-compute[74839]:   <features>
Nov 18 15:44:35 user nova-compute[74839]:     <acpi/>
Nov 18 15:44:35 user nova-compute[74839]:     <apic/>
Nov 18 15:44:35 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:44:35 user nova-compute[74839]:   </features>
Nov 18 15:44:35 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:44:35 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:44:35 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:44:35 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:44:35 user nova-compute[74839]:   </clock>
Nov 18 15:44:35 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:44:35 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:44:35 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:44:35 user nova-compute[74839]:   </cpu>
Nov 18 15:44:35 user nova-compute[74839]:   <devices>
Nov 18 15:44:35 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:44:35 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:44:35 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk"/>
Nov 18 15:44:35 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:44:35 user nova-compute[74839]:     </disk>
Nov 18 15:44:35 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:44:35 user nova-compute[74839]:       <mac address="fa:16:3e:c5:f4:e7"/>
Nov 18 15:44:35 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:44:35 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:44:35 user nova-compute[74839]:       <target dev="tap5d6d8b9e-38"/>
Nov 18 15:44:35 user nova-compute[74839]:     </interface>
Nov 18 15:44:35 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:44:35 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/console.log" append="off"/>
Nov 18 15:44:35 user nova-compute[74839]:     </serial>
Nov 18 15:44:35 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:44:35 user nova-compute[74839]:     <video>
Nov 18 15:44:35 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:44:35 user nova-compute[74839]:     </video>
Nov 18 15:44:35 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:44:35 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:44:35 user nova-compute[74839]:     </rng>
Nov 18 15:44:35 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:44:35 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:44:35 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:44:35 user nova-compute[74839]:     </memballoon>
Nov 18 15:44:35 user nova-compute[74839]:   </devices>
Nov 18 15:44:35 user nova-compute[74839]: </domain>
Nov 18 15:44:35 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546014982',display_name='tempest-TestServerVolumeAttachmentScenario-server-546014982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546014982',id=28,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0lJ1srp9V3uxk4LyjvlTpM2MosPN9ZBwQEtNoi1FwbWFhs0uLnjliIxR4XRCs4acT9/+XG8CZ8axFDlRIcY7MquJlYuuMLteiaN2FRLk0HnGBv2siH4YE1amRhyk/qw==',key_name='tempest-keypair-257006294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79791998433644babc3a23a9bcc83b32',ramdisk_id='',reservation_id='r-za1hsiiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1596425973',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1596425973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa275451859e4d35a4c7f5fcd7f48bbd',uuid=6fe9d3d8-f17e-447d-9d7f-d215b45f4a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converting VIF {"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG os_vif [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07688896-1e78-5be0-8b79-7950cb3c329c', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d6d8b9e-38, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d6d8b9e-38, col_values=(('qos', UUID('66fd2b1d-817a-4dcc-bcc9-6203651cf699')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d6d8b9e-38, col_values=(('external_ids', {'iface-id': '5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f4:e7', 'vm-uuid': '6fe9d3d8-f17e-447d-9d7f-d215b45f4a53'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:35 user nova-compute[74839]: INFO os_vif [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38')
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No VIF found with MAC fa:16:3e:c5:f4:e7, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updated VIF entry in instance network info cache for port 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG nova.network.neutron [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating instance_info_cache with network_info: [{"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1b45b039-c582-4fe7-8038-93c78a0b76b5 req-694844db-2d27-4b13-9100-a8943bf587c0 service nova] Releasing lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] No waiting events found dispatching network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:37 user nova-compute[74839]: WARNING nova.compute.manager [req-2a5a9e62-378b-4610-8ed3-8149f0259e9b req-6a7c7cb6-82e0-405d-8090-1088938bc41c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received unexpected event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 for instance with vm_state building and task_state spawning.
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:44:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Instance spawned successfully.
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:44:39 user nova-compute[74839]: INFO nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] No waiting events found dispatching network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:39 user nova-compute[74839]: WARNING nova.compute.manager [req-437196e4-2fc1-4af9-a1aa-81db6ac0e926 req-2249571d-4376-4d73-b3fa-bdc97139df2a service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received unexpected event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 for instance with vm_state building and task_state spawning.
Nov 18 15:44:39 user nova-compute[74839]: INFO nova.compute.manager [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Took 5.79 seconds to build instance.
Nov 18 15:44:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5697d49d-14f5-4a62-ae5a-da772b277e1e tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.895s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:40 user nova-compute[74839]: INFO nova.compute.manager [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Rescuing
Nov 18 15:44:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:41 user nova-compute[74839]: WARNING nova.compute.manager [req-b4d712d3-5b38-4912-b4f9-b67b9c7fbf20 req-a3f532ac-e7e5-4507-94c6-4a4d22f3eb27 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state active and task_state rescuing.
Nov 18 15:44:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance destroyed successfully.
Nov 18 15:44:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Attempting rescue
Nov 18 15:44:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:44:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Creating image(s)
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'trusted_certs' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.381s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'migration_context' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.base [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<defa77fc-949a-4b92-b717-559fa24b7a2c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start _get_guest_xml network_info=[{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:7c:a4:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.base [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<defa77fc-949a-4b92-b717-559fa24b7a2c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'numa_topology' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.base [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<defa77fc-949a-4b92-b717-559fa24b7a2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:44:42 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:42 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'vcpu_model' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.base [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<defa77fc-949a-4b92-b717-559fa24b7a2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633021265',display_name='tempest-ServerRescueNegativeTestJSON-server-633021265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633021265',id=22,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-0km87nrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:40:04Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=defa77fc-949a-4b92-b717-559fa24b7a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:7c:a4:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:7c:a4:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.objects.base [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<defa77fc-949a-4b92-b717-559fa24b7a2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:44:42 user nova-compute[74839]:   <uuid>defa77fc-949a-4b92-b717-559fa24b7a2c</uuid>
Nov 18 15:44:42 user nova-compute[74839]:   <name>instance-00000016</name>
Nov 18 15:44:42 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:44:42 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:44:42 user nova-compute[74839]:   <metadata>
Nov 18 15:44:42 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:44:42 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-633021265</nova:name>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:44:42</nova:creationTime>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:44:42 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:44:42 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:owner>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:44:42 user nova-compute[74839]:       </nova:owner>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:44:42 user nova-compute[74839]:       <nova:ports>
Nov 18 15:44:42 user nova-compute[74839]:         <nova:port uuid="bac9dbee-a574-4473-afa0-4c6838c60212">
Nov 18 15:44:42 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:44:42 user nova-compute[74839]:         </nova:port>
Nov 18 15:44:42 user nova-compute[74839]:       </nova:ports>
Nov 18 15:44:42 user nova-compute[74839]:     </nova:instance>
Nov 18 15:44:42 user nova-compute[74839]:   </metadata>
Nov 18 15:44:42 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:44:42 user nova-compute[74839]:     <system>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="serial">defa77fc-949a-4b92-b717-559fa24b7a2c</entry>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="uuid">defa77fc-949a-4b92-b717-559fa24b7a2c</entry>
Nov 18 15:44:42 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:44:42 user nova-compute[74839]:     </system>
Nov 18 15:44:42 user nova-compute[74839]:   </sysinfo>
Nov 18 15:44:42 user nova-compute[74839]:   <os>
Nov 18 15:44:42 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:44:42 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:44:42 user nova-compute[74839]:   </os>
Nov 18 15:44:42 user nova-compute[74839]:   <features>
Nov 18 15:44:42 user nova-compute[74839]:     <acpi/>
Nov 18 15:44:42 user nova-compute[74839]:     <apic/>
Nov 18 15:44:42 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:44:42 user nova-compute[74839]:   </features>
Nov 18 15:44:42 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:44:42 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:44:42 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:44:42 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:44:42 user nova-compute[74839]:   </clock>
Nov 18 15:44:42 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:44:42 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:44:42 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:44:42 user nova-compute[74839]:   </cpu>
Nov 18 15:44:42 user nova-compute[74839]:   <devices>
Nov 18 15:44:42 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:44:42 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:44:42 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue"/>
Nov 18 15:44:42 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:44:42 user nova-compute[74839]:     </disk>
Nov 18 15:44:42 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:44:42 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:44:42 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk"/>
Nov 18 15:44:42 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:44:42 user nova-compute[74839]:     </disk>
Nov 18 15:44:42 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:44:42 user nova-compute[74839]:       <mac address="fa:16:3e:7c:a4:25"/>
Nov 18 15:44:42 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:44:42 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:44:42 user nova-compute[74839]:       <target dev="tapbac9dbee-a5"/>
Nov 18 15:44:42 user nova-compute[74839]:     </interface>
Nov 18 15:44:42 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:44:42 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/console.log" append="off"/>
Nov 18 15:44:42 user nova-compute[74839]:     </serial>
Nov 18 15:44:42 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:44:42 user nova-compute[74839]:     <video>
Nov 18 15:44:42 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:44:42 user nova-compute[74839]:     </video>
Nov 18 15:44:42 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:44:42 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:44:42 user nova-compute[74839]:     </rng>
Nov 18 15:44:42 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:44:42 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:44:42 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:44:42 user nova-compute[74839]:     </memballoon>
Nov 18 15:44:42 user nova-compute[74839]:   </devices>
Nov 18 15:44:42 user nova-compute[74839]: </domain>
Nov 18 15:44:42 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:44:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance destroyed successfully.
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:7c:a4:25, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:44:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:43 user nova-compute[74839]: INFO nova.compute.manager [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Terminating instance
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:43 user nova-compute[74839]: WARNING nova.compute.manager [req-5b19e154-2a55-4cf9-8792-c0717554180a req-f77c72a3-ca52-4964-9148-c9140fd49482 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state active and task_state rescuing.
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-cafe2331-ca03-4563-8a9c-77ab45460662 req-4b74836a-3558-4ed6-9316-0502c58b3851 service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-unplugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:44:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Instance destroyed successfully.
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lazy-loading 'resources' on Instance uuid 693e326d-b414-425b-b318-6f57486154a2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895332168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895332168',id=20,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrvGpCDvOQwk0TLgwbzhuqbUVWtzPRU+oZGOqRTB12Jz2GHKlSVrOxXFQwqzpfsQht1kM5sBNtXEQ3yMHb9LeU8De+J0se0lfX83pGoINtHolXN4bSplywzQRFG/ZSMKQ==',key_name='tempest-keypair-864750464',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:43:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfa5a922984458fbccbdebc0a906763',ramdisk_id='',reservation_id='r-opfm8l5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-619260582',owner_user_name='tempest-AttachVolumeShelveTestJSON-619260582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:43:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7acc8cec037e4e0081c72125cc4c6db9',uuid=693e326d-b414-425b-b318-6f57486154a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converting VIF {"id": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "address": "fa:16:3e:e8:4b:72", "network": {"id": "d34ade2b-4ac3-4997-8353-282787cbd487", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1786006868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfa5a922984458fbccbdebc0a906763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c9c001-9d", "ovs_interfaceid": "34c9c001-9d3b-40d9-a028-4af1c6d5cc49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG os_vif [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34c9c001-9d, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb898c3e-3936-4509-a028-ec8720d6a141) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:44 user nova-compute[74839]: INFO os_vif [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4b:72,bridge_name='br-int',has_traffic_filtering=True,id=34c9c001-9d3b-40d9-a028-4af1c6d5cc49,network=Network(d34ade2b-4ac3-4997-8353-282787cbd487),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34c9c001-9d')
Nov 18 15:44:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Deleting instance files /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2_del
Nov 18 15:44:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Deletion of /opt/stack/data/nova/instances/693e326d-b414-425b-b318-6f57486154a2_del complete
Nov 18 15:44:44 user nova-compute[74839]: INFO nova.compute.manager [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] [instance: 693e326d-b414-425b-b318-6f57486154a2] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:45 user nova-compute[74839]: WARNING nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state active and task_state rescuing.
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:45 user nova-compute[74839]: WARNING nova.compute.manager [req-c1da1015-e0c2-45fa-adc9-c0f38e137b90 req-13b634e8-b5ea-4647-8ad2-97621cb9a1e9 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state active and task_state rescuing.
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:45 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 693e326d-b414-425b-b318-6f57486154a2] Took 0.85 seconds to deallocate network for instance.
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] Acquiring lock "693e326d-b414-425b-b318-6f57486154a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] Lock "693e326d-b414-425b-b318-6f57486154a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] No waiting events found dispatching network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:45 user nova-compute[74839]: WARNING nova.compute.manager [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received unexpected event network-vif-plugged-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 for instance with vm_state deleted and task_state None.
Nov 18 15:44:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-1e94b083-ab2b-443b-923a-f08bbdf4aa1e req-ab8c5fa9-a8ee-45eb-a52f-20e04058dd4c service nova] [instance: 693e326d-b414-425b-b318-6f57486154a2] Received event network-vif-deleted-34c9c001-9d3b-40d9-a028-4af1c6d5cc49 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:46 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Deleted allocations for instance 693e326d-b414-425b-b318-6f57486154a2
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d3b8fb50-d286-4923-8d68-3681734ac247 tempest-AttachVolumeShelveTestJSON-619260582 tempest-AttachVolumeShelveTestJSON-619260582-project-member] Lock "693e326d-b414-425b-b318-6f57486154a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.093s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0a093dff-f914-44f7-9efd-e3a1c7c332f2 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:50 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:50 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7665MB free_disk=25.257720947265625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 24fe45b3-613e-482d-988e-f72d865571b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:44:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:44:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:44:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing instance network info cache due to event network-changed-0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] Acquiring lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] Acquired lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG nova.network.neutron [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Refreshing network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:57 user nova-compute[74839]: INFO nova.compute.manager [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Terminating instance
Nov 18 15:44:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updated VIF entry in instance network info cache for port 0c211e29-d8bc-42e5-bfde-9ddd13447595. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.neutron [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [{"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-f1d76679-4f52-4ddc-a0ea-1385c76b81ed req-68a1fefd-5b09-4fc6-b7f8-e7ff697cea68 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-unplugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b362e51-e79f-488d-a957-43578bcaef89 req-b45ebe42-c75f-4e69-83e1-a548a898f554 service nova] Releasing lock "refresh_cache-4496a0ec-d5c5-499a-8e93-0cbefac56fca" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:58 user nova-compute[74839]: INFO nova.compute.manager [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Rescuing
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:44:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Instance destroyed successfully.
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lazy-loading 'resources' on Instance uuid 4496a0ec-d5c5-499a-8e93-0cbefac56fca {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-287785288',display_name='tempest-TestShelveInstance-server-287785288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-287785288',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9vnkihyzUeTz20lvqjRoWPio3VkWICSH0yiHO11eVGVR14m213wnUtK8MeUtKCC9Eb+6FISuzQRLFa7VBJmV7DkEgNXqTlrt29wf9sb+Rq7LU1TTfgmYY65l9w4zgrWQ==',key_name='tempest-TestShelveInstance-1435268891',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0791e06caa2f4df2b8415d8014888775',ramdisk_id='',reservation_id='r-67dd37cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-284363904',owner_user_name='tempest-TestShelveInstance-284363904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:43:21Z,user_data=None,user_id='9b3b23664b394fae9ce3bb99461fe9e2',uuid=4496a0ec-d5c5-499a-8e93-0cbefac56fca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converting VIF {"id": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "address": "fa:16:3e:13:6a:43", "network": {"id": "892b8544-2c84-49d8-a952-2fab7d8ea8f6", "bridge": "br-int", "label": "tempest-TestShelveInstance-56459124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0791e06caa2f4df2b8415d8014888775", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c211e29-d8", "ovs_interfaceid": "0c211e29-d8bc-42e5-bfde-9ddd13447595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_vif [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c211e29-d8, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccc0015e-2c87-494c-9f22-1adf41049a80) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:44:58 user nova-compute[74839]: INFO os_vif [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:6a:43,bridge_name='br-int',has_traffic_filtering=True,id=0c211e29-d8bc-42e5-bfde-9ddd13447595,network=Network(892b8544-2c84-49d8-a952-2fab7d8ea8f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c211e29-d8')
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psPecaBQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:44:58 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd16b7-653e-4d25-a748-9622acd05b7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:44:58 user nova-compute[74839]: No targets found.
Nov 18 15:44:58 user nova-compute[74839]: iSNS:
Nov 18 15:44:58 user nova-compute[74839]: No targets found.
Nov 18 15:44:58 user nova-compute[74839]: STATIC:
Nov 18 15:44:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:44:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:44:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:44:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:44:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:44:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:44:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb
Nov 18 15:44:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:44:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:44:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:44:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:44:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:44:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:44:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:44:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:44:58 user nova-compute[74839]: FIRMWARE:
Nov 18 15:44:58 user nova-compute[74839]: No targets found.
Nov 18 15:44:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:44:58 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:44:58 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d1afb-179d-4ba5-abf0-7752b940b405]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b148bd6-68c2-4033-870d-94a1930eab6a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:44:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb (non-flash)
Nov 18 15:44:58 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:44:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a11e2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72f02d3-dc64-4af4-91cc-6ae5731c5499]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed419ea1-1675-4f82-823c-008ead1dda5c]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95bdc9-1a13-4a32-bbc0-267dfdfe875e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[62539b38-1369-4fa9-bf28-f76b6f4ca1b1]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6553ae5e-fe9c866e05f49289', '/dev/disk/by-id/scsi-26665396338363665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6553ae5e') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5469904-b944-47d0-afd6-b7a0ac2af617]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5481af-b983-4b94-8f07-ed89d59b852b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9325f-3074-4be1-a324-1dae3cee3c89]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260]
Nov 18 15:44:58 user nova-compute[74839]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb, portal: 172.16.0.220,3260] successful.
Nov 18 15:44:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a32176d-b2f5-4758-861a-ef71a0deb3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0b889-2dc5-4a70-aca2-1aed80ee64a7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] <== disconnect_volume: return (339ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:44:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deleting instance files /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca_del
Nov 18 15:44:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deletion of /opt/stack/data/nova/instances/4496a0ec-d5c5-499a-8e93-0cbefac56fca_del complete
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:44:58 user nova-compute[74839]: INFO nova.compute.manager [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 18 15:44:58 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:44:58 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:44:59 user nova-compute[74839]: WARNING nova.compute.manager [req-124a6a44-2c90-414d-b141-00b8105a17e0 req-5c6bb1b0-ae42-4d6c-90c6-c532fccc08f2 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state rescuing.
Nov 18 15:44:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:44:59 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Took 0.50 seconds to deallocate network for instance.
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-371c4d51-40f7-4e69-bc07-dfa209d31072 req-d911a81f-a804-4b76-bf1e-2331396f8b93 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-deleted-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:44:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance destroyed successfully.
Nov 18 15:44:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Attempting a stable device rescue
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:44:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Creating image(s)
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:44:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:01 user nova-compute[74839]: INFO nova.compute.manager [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Took 1.64 seconds to detach 1 volumes for instance.
Nov 18 15:45:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] Acquiring lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] No waiting events found dispatching network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:01 user nova-compute[74839]: WARNING nova.compute.manager [req-841d374d-a204-4105-80f3-c94df8c696fa req-d78f2652-a3d4-4e0c-bc8c-6452b8dccd02 service nova] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Received unexpected event network-vif-plugged-0c211e29-d8bc-42e5-bfde-9ddd13447595 for instance with vm_state active and task_state deleting.
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] [instance: 4496a0ec-d5c5-499a-8e93-0cbefac56fca] Deleting volume: 9a32176d-b2f5-4758-861a-ef71a0deb3cb {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.virt.images [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] 117ebdce-2b14-4156-8d9a-d4185ccaa689 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.part /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:01 user nova-compute[74839]: WARNING nova.compute.manager [req-5bf03a76-8e33-4378-9769-78d964c53836 req-1ffbb28d-0e41-4ced-8f72-80d97357f400 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state rescuing.
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.part /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.converted" returned: 0 in 0.367s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.032s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:01 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Deleted allocations for instance 4496a0ec-d5c5-499a-8e93-0cbefac56fca
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d,backing_fmt=raw /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d,backing_fmt=raw /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue" returned: 0 in 0.064s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "880cc69576fdc711d7bbcc41839225cbd1ff827d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'migration_context' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ddf13d0c-4595-4fb3-a3ce-6d28aaee76e9 tempest-TestShelveInstance-284363904 tempest-TestShelveInstance-284363904-project-member] Lock "4496a0ec-d5c5-499a-8e93-0cbefac56fca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.331s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<24fe45b3-613e-482d-988e-f72d865571b8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start _get_guest_xml network_info=[{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:2a:3a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '117ebdce-2b14-4156-8d9a-d4185ccaa689', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f4f644dd-3b90-4cfa-bf1d-bebd7d17c5fb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '24fe45b3-613e-482d-988e-f72d865571b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'serial': 'ee3d83f7-9f93-41a4-9a8d-323ae4c0692a'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<24fe45b3-613e-482d-988e-f72d865571b8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'numa_topology' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<24fe45b3-613e-482d-988e-f72d865571b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:45:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<24fe45b3-613e-482d-988e-f72d865571b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:45:02 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:45:02 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:45:02 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d055af43-39d8-4906-a15e-04e1b109cea2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XtoWBELD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 15:45:02 user nova-compute[74839]: node.name = iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:45:02 user nova-compute[74839]: node.tpgt = -1
Nov 18 15:45:02 user nova-compute[74839]: node.startup = automatic
Nov 18 15:45:02 user nova-compute[74839]: node.leading_login = No
Nov 18 15:45:02 user nova-compute[74839]: iface.iscsi_ifacename = default
Nov 18 15:45:02 user nova-compute[74839]: iface.net_ifacename = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.ipaddress = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.prefix_len = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.hwaddress = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.transport_name = tcp
Nov 18 15:45:02 user nova-compute[74839]: iface.initiatorname = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.vlan_id = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.vlan_priority = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.vlan_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.iface_num = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.mtu = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.port = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.bootproto = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.subnet_mask = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.gateway = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_alt_client_id = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_dns = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_learn_iqn = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_vendor_id_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_vendor_id = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.dhcp_slp_da = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.fragmentation = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.gratuitous_arp = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.incoming_forwarding = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.tos_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.tos = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.ttl = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.delayed_ack = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.tcp_nagle = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.tcp_wsf_state = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.tcp_wsf = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.tcp_timer_scale = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.tcp_timestamp = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.redirect = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.def_task_mgmt_timeout = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.header_digest = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.data_digest = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.immediate_data = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.initial_r2t = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.data_seq_inorder = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.data_pdu_inorder = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.erl = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.max_receive_data_len = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.first_burst_len = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.max_outstanding_r2t = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.max_burst_len = 0
Nov 18 15:45:02 user nova-compute[74839]: iface.chap_auth = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.bidi_chap = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.strict_login_compliance = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.discovery_auth = <empty>
Nov 18 15:45:02 user nova-compute[74839]: iface.discovery_logout = <empty>
Nov 18 15:45:02 user nova-compute[74839]: node.discovery_address = <empty>
Nov 18 15:45:02 user nova-compute[74839]: node.discovery_port = 0
Nov 18 15:45:02 user nova-compute[74839]: node.discovery_type = static
Nov 18 15:45:02 user nova-compute[74839]: node.session.initial_cmdsn = 0
Nov 18 15:45:02 user nova-compute[74839]: node.session.initial_login_retry_max = 8
Nov 18 15:45:02 user nova-compute[74839]: node.session.xmit_thread_priority = -20
Nov 18 15:45:02 user nova-compute[74839]: node.session.cmds_max = 128
Nov 18 15:45:02 user nova-compute[74839]: node.session.queue_depth = 32
Nov 18 15:45:02 user nova-compute[74839]: node.session.nr_sessions = 1
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.authmethod = CHAP
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.username = XtoWBELD
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.password = ***
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.username_in = <empty>
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.password_in = <empty>
Nov 18 15:45:02 user nova-compute[74839]: node.session.auth.chap_algs = MD5
Nov 18 15:45:02 user nova-compute[74839]: node.session.timeo.replacement_timeout = 120
Nov 18 15:45:02 user nova-compute[74839]: node.session.err_timeo.abort_timeout = 15
Nov 18 15:45:02 user nova-compute[74839]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 15:45:02 user nova-compute[74839]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 15:45:02 user nova-compute[74839]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.FastAbort = Yes
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.InitialR2T = No
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.ImmediateData = Yes
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.MaxConnections = 1
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 15:45:02 user nova-compute[74839]: node.session.iscsi.ERL = 0
Nov 18 15:45:02 user nova-compute[74839]: node.session.scan = manual
Nov 18 15:45:02 user nova-compute[74839]: node.session.reopen_max = 0
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].address = 172.16.0.220
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].port = 3260
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].startup = manual
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].tcp.window_size = 524288
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].tcp.type_of_service = 0
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].timeo.logout_timeout = 15
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].timeo.login_timeout = 15
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].timeo.auth_timeout = 45
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.DataDigest = None
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.IFMarker = No
Nov 18 15:45:02 user nova-compute[74839]: node.conn[0].iscsi.OFMarker = No
Nov 18 15:45:02 user nova-compute[74839]: # END RECORD
Nov 18 15:45:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[071e9b92-5b7e-434e-beff-73a6bc957a52]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.147s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[05145609-feca-40d8-b298-116a0aa7ab6d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtoWBELD {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtoWBELD" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878881f-ebd3-4988-a8db-d54b4405e6b8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XtoWBELD'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc19c9d0-e798-4cfb-aea5-b852b105fea5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a5368-1d69-40d4-8c4a-b0123807860f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:02 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:02 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] HCTL ('37', '0', '0', 0) found on session 31 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db354f0b-5c27-42c9-b7a4-4c5b7ce5bb01]: (4, ('0 0 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Searching for a device in session 31 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.299s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== connect_volume: return (301ms) {'type': 'block', 'scsi_wwn': '26237623236373835', 'path': '/dev/sdf'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623236373835', 'path': '/dev/sdf'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347918971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347918971',id=27,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-dl1f2mh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:43:31Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=24fe45b3-613e-482d-988e-f72d865571b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:2a:3a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "vif_mac": "fa:16:3e:2a:3a:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Object Instance<24fe45b3-613e-482d-988e-f72d865571b8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:45:02 user nova-compute[74839]:   <uuid>24fe45b3-613e-482d-988e-f72d865571b8</uuid>
Nov 18 15:45:02 user nova-compute[74839]:   <name>instance-0000001b</name>
Nov 18 15:45:02 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:45:02 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:45:02 user nova-compute[74839]:   <metadata>
Nov 18 15:45:02 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:45:02 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-347918971</nova:name>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:45:02</nova:creationTime>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:45:02 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:45:02 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:owner>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:user uuid="a1b86e5899c041e88609206af0613940">tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member</nova:user>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:project uuid="fb0b5e1598374e26b3b0c081e6ca38d3">tempest-ServerBootFromVolumeStableRescueTest-1367062949</nova:project>
Nov 18 15:45:02 user nova-compute[74839]:       </nova:owner>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:45:02 user nova-compute[74839]:       <nova:ports>
Nov 18 15:45:02 user nova-compute[74839]:         <nova:port uuid="5492bcba-54cf-4e9c-9773-25d45b6a0a1a">
Nov 18 15:45:02 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:45:02 user nova-compute[74839]:         </nova:port>
Nov 18 15:45:02 user nova-compute[74839]:       </nova:ports>
Nov 18 15:45:02 user nova-compute[74839]:     </nova:instance>
Nov 18 15:45:02 user nova-compute[74839]:   </metadata>
Nov 18 15:45:02 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:45:02 user nova-compute[74839]:     <system>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="serial">24fe45b3-613e-482d-988e-f72d865571b8</entry>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="uuid">24fe45b3-613e-482d-988e-f72d865571b8</entry>
Nov 18 15:45:02 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:45:02 user nova-compute[74839]:     </system>
Nov 18 15:45:02 user nova-compute[74839]:   </sysinfo>
Nov 18 15:45:02 user nova-compute[74839]:   <os>
Nov 18 15:45:02 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:45:02 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:45:02 user nova-compute[74839]:   </os>
Nov 18 15:45:02 user nova-compute[74839]:   <features>
Nov 18 15:45:02 user nova-compute[74839]:     <acpi/>
Nov 18 15:45:02 user nova-compute[74839]:     <apic/>
Nov 18 15:45:02 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:45:02 user nova-compute[74839]:   </features>
Nov 18 15:45:02 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:45:02 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:45:02 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:45:02 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:45:02 user nova-compute[74839]:   </clock>
Nov 18 15:45:02 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:45:02 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:45:02 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:45:02 user nova-compute[74839]:   </cpu>
Nov 18 15:45:02 user nova-compute[74839]:   <devices>
Nov 18 15:45:02 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:45:02 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:45:02 user nova-compute[74839]:       <source dev="/dev/sdf"/>
Nov 18 15:45:02 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:45:02 user nova-compute[74839]:       <serial>ee3d83f7-9f93-41a4-9a8d-323ae4c0692a</serial>
Nov 18 15:45:02 user nova-compute[74839]:     </disk>
Nov 18 15:45:02 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:45:02 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:45:02 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue"/>
Nov 18 15:45:02 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:45:02 user nova-compute[74839]:       <boot order="1"/>
Nov 18 15:45:02 user nova-compute[74839]:     </disk>
Nov 18 15:45:02 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:45:02 user nova-compute[74839]:       <mac address="fa:16:3e:2a:3a:3a"/>
Nov 18 15:45:02 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:45:02 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:45:02 user nova-compute[74839]:       <target dev="tap5492bcba-54"/>
Nov 18 15:45:02 user nova-compute[74839]:     </interface>
Nov 18 15:45:02 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:45:02 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/console.log" append="off"/>
Nov 18 15:45:02 user nova-compute[74839]:     </serial>
Nov 18 15:45:02 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:45:02 user nova-compute[74839]:     <video>
Nov 18 15:45:02 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:45:02 user nova-compute[74839]:     </video>
Nov 18 15:45:02 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:45:02 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:45:02 user nova-compute[74839]:     </rng>
Nov 18 15:45:02 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:45:02 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:45:02 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:45:02 user nova-compute[74839]:     </memballoon>
Nov 18 15:45:02 user nova-compute[74839]:   </devices>
Nov 18 15:45:02 user nova-compute[74839]: </domain>
Nov 18 15:45:02 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:45:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance destroyed successfully.
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:45:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] No VIF found with MAC fa:16:3e:2a:3a:3a, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:45:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:04 user nova-compute[74839]: WARNING nova.compute.manager [req-77a32632-58b7-4297-801f-54a7021ce123 req-6558af53-e9a3-4335-8cb4-255e102c6010 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state rescuing.
Nov 18 15:45:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6b68e27f-c4ae-4955-b6dd-20eb9a0f2300 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:06 user nova-compute[74839]: WARNING nova.compute.manager [req-f44ee05c-33cc-471e-ad05-79e90e6020b3 req-8e4ead02-2d94-49d0-831d-ad0d5abde2af service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state rescuing.
Nov 18 15:45:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:45:16 user nova-compute[74839]: INFO nova.compute.claims [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Claim successful on node user
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:45:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.policy [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd5091855f2647abba05a98492302656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d67202285b746fb80c72ae0d42394d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:45:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Creating image(s)
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "/opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "/opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk 1073741824" returned: 0 in 0.062s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Successfully created port: d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:17 user nova-compute[74839]: INFO nova.compute.manager [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Terminating instance
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Cannot resize image /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Ensure instance console log exists: /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-2368ac9d-c757-4045-8bb8-a1f731d2ee77 req-000e88a8-c849-4405-bb5f-2424673c6781 service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-unplugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Successfully updated port: d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquired lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-changed-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Refreshing instance network info cache due to event network-changed-d9a32609-d53b-4227-b209-c4c01cbb3d2b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] Acquiring lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:45:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Instance destroyed successfully.
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.objects.instance [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lazy-loading 'resources' on Instance uuid 33c2ac3e-6465-4d42-8cf8-15432abc1b53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-419458110',display_name='tempest-ServerActionsTestOtherB-server-419458110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-419458110',id=16,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGoFrMf8GnYDRvMvUhYHonw1Uktz4lym02fdYMPQYvj4vL9cKVjBHnMs9wLws8UZf+5S9GYVYFCEGYwO2t8+GPE7fqGF2YZWU1WciyDrL6iIPz25796mhlxEO0PxRcV6g==',key_name='tempest-keypair-683712222',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a10ded07c8ca4a14ae16a8b2f568572c',ramdisk_id='',reservation_id='r-rtkn2869',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1220678825',owner_user_name='tempest-ServerActionsTestOtherB-1220678825-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='202cc39d991b49468d4922bddcf93381',uuid=33c2ac3e-6465-4d42-8cf8-15432abc1b53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converting VIF {"id": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "address": "fa:16:3e:6f:dd:da", "network": {"id": "367dba89-f097-4aae-9082-daec8f1466fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1182669428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a10ded07c8ca4a14ae16a8b2f568572c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471ecda0-d7", "ovs_interfaceid": "471ecda0-d7f6-4e68-946a-5b7286f0445a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_vif [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471ecda0-d7, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5eb2747b-faae-46b6-80a4-1a32eb93be4f) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:45:18 user nova-compute[74839]: INFO os_vif [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:dd:da,bridge_name='br-int',has_traffic_filtering=True,id=471ecda0-d7f6-4e68-946a-5b7286f0445a,network=Network(367dba89-f097-4aae-9082-daec8f1466fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471ecda0-d7')
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Ohygwvku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:45:18 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ce857b-1e3d-4e45-859c-76459e343fd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:45:18 user nova-compute[74839]: No targets found.
Nov 18 15:45:18 user nova-compute[74839]: iSNS:
Nov 18 15:45:18 user nova-compute[74839]: No targets found.
Nov 18 15:45:18 user nova-compute[74839]: STATIC:
Nov 18 15:45:18 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:45:18 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:18 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:18 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:45:18 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:18 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:18 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7
Nov 18 15:45:18 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:18 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:18 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:45:18 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:18 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:18 user nova-compute[74839]: FIRMWARE:
Nov 18 15:45:18 user nova-compute[74839]: No targets found.
Nov 18 15:45:18 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:45:18 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:45:18 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759c5df-e606-42f3-b01f-cc5e11f9d134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2417485d-8108-4e6e-ac85-93623f654bcf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:18 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:18 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:18 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c6449d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[375218f1-e385-4b8b-afc1-f2b629ebbc88]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updating instance_info_cache with network_info: [{"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bbcb90-1c32-4309-a2b5-c132f456f2f8]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Releasing lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Instance network_info: |[{"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] Acquired lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Refreshing network info cache for port d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Start _get_guest_xml network_info=[{"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5852654-93b0-4c26-8174-2986f57e0bdf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:18 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1012458988',display_name='tempest-AttachVolumeNegativeTest-server-1012458988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1012458988',id=29,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJeL9KeETGGwji1v9w7xNJqNw2kUyNZeZAY4Qh0lzQg1SbNLzHGjN68ZDZp8unYJNd7JMun5gA8oAquNiDB6I+euTuND7PQDW0sGNdy0kj8Sctct/czxXLz0EmunFK8bQ==',key_name='tempest-keypair-858234225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-1hgr6afv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=b268974e-5600-42cd-bad1-b4eabf231b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.objects.instance [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'pci_devices' on Instance uuid b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c5243-9316-43ff-b1c1-1d0c24746825]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:45:18 user nova-compute[74839]:   <uuid>b268974e-5600-42cd-bad1-b4eabf231b0d</uuid>
Nov 18 15:45:18 user nova-compute[74839]:   <name>instance-0000001d</name>
Nov 18 15:45:18 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:45:18 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:45:18 user nova-compute[74839]:   <metadata>
Nov 18 15:45:18 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:45:18 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1012458988</nova:name>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:45:18</nova:creationTime>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:45:18 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:45:18 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:owner>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:user uuid="fd5091855f2647abba05a98492302656">tempest-AttachVolumeNegativeTest-183955382-project-member</nova:user>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:project uuid="9d67202285b746fb80c72ae0d42394d5">tempest-AttachVolumeNegativeTest-183955382</nova:project>
Nov 18 15:45:18 user nova-compute[74839]:       </nova:owner>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:45:18 user nova-compute[74839]:       <nova:ports>
Nov 18 15:45:18 user nova-compute[74839]:         <nova:port uuid="d9a32609-d53b-4227-b209-c4c01cbb3d2b">
Nov 18 15:45:18 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:45:18 user nova-compute[74839]:         </nova:port>
Nov 18 15:45:18 user nova-compute[74839]:       </nova:ports>
Nov 18 15:45:18 user nova-compute[74839]:     </nova:instance>
Nov 18 15:45:18 user nova-compute[74839]:   </metadata>
Nov 18 15:45:18 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:45:18 user nova-compute[74839]:     <system>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="serial">b268974e-5600-42cd-bad1-b4eabf231b0d</entry>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="uuid">b268974e-5600-42cd-bad1-b4eabf231b0d</entry>
Nov 18 15:45:18 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:45:18 user nova-compute[74839]:     </system>
Nov 18 15:45:18 user nova-compute[74839]:   </sysinfo>
Nov 18 15:45:18 user nova-compute[74839]:   <os>
Nov 18 15:45:18 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:45:18 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:45:18 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:45:18 user nova-compute[74839]:   </os>
Nov 18 15:45:18 user nova-compute[74839]:   <features>
Nov 18 15:45:18 user nova-compute[74839]:     <acpi/>
Nov 18 15:45:18 user nova-compute[74839]:     <apic/>
Nov 18 15:45:18 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:45:18 user nova-compute[74839]:   </features>
Nov 18 15:45:18 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:45:18 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:45:18 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:45:18 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:45:18 user nova-compute[74839]:   </clock>
Nov 18 15:45:18 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:45:18 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:45:18 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:45:18 user nova-compute[74839]:   </cpu>
Nov 18 15:45:18 user nova-compute[74839]:   <devices>
Nov 18 15:45:18 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:45:18 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:45:18 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk"/>
Nov 18 15:45:18 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:45:18 user nova-compute[74839]:     </disk>
Nov 18 15:45:18 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:45:18 user nova-compute[74839]:       <mac address="fa:16:3e:34:0f:a6"/>
Nov 18 15:45:18 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:45:18 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:45:18 user nova-compute[74839]:       <target dev="tapd9a32609-d5"/>
Nov 18 15:45:18 user nova-compute[74839]:     </interface>
Nov 18 15:45:18 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:45:18 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/console.log" append="off"/>
Nov 18 15:45:18 user nova-compute[74839]:     </serial>
Nov 18 15:45:18 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:45:18 user nova-compute[74839]:     <video>
Nov 18 15:45:18 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:45:18 user nova-compute[74839]:     </video>
Nov 18 15:45:18 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:45:18 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:45:18 user nova-compute[74839]:     </rng>
Nov 18 15:45:18 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:45:18 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:45:18 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:45:18 user nova-compute[74839]:     </memballoon>
Nov 18 15:45:18 user nova-compute[74839]:   </devices>
Nov 18 15:45:18 user nova-compute[74839]: </domain>
Nov 18 15:45:18 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1012458988',display_name='tempest-AttachVolumeNegativeTest-server-1012458988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1012458988',id=29,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJeL9KeETGGwji1v9w7xNJqNw2kUyNZeZAY4Qh0lzQg1SbNLzHGjN68ZDZp8unYJNd7JMun5gA8oAquNiDB6I+euTuND7PQDW0sGNdy0kj8Sctct/czxXLz0EmunFK8bQ==',key_name='tempest-keypair-858234225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-1hgr6afv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=b268974e-5600-42cd-bad1-b4eabf231b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_vif [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd081e4f4-c492-5162-9412-4a8ba308ec6a', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9a32609-d5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9a32609-d5, col_values=(('qos', UUID('677cfb44-f4b2-4bce-95f6-c3220532383e')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9a32609-d5, col_values=(('external_ids', {'iface-id': 'd9a32609-d53b-4227-b209-c4c01cbb3d2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:0f:a6', 'vm-uuid': 'b268974e-5600-42cd-bad1-b4eabf231b0d'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e828af-08e0-4300-89ae-b5343bbe4424]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:18 user nova-compute[74839]: INFO os_vif [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5')
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f8ca5-df6e-4637-bad3-6a342753a329]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260]
Nov 18 15:45:18 user nova-compute[74839]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7, portal: 172.16.0.220,3260] successful.
Nov 18 15:45:18 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:34:0f:a6, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670bcb57-1038-4d06-87b0-08842fa4ffb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f845e2-7b28-4583-9940-27d0ff0d011e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] <== disconnect_volume: return (359ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:45:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Deleting instance files /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_del
Nov 18 15:45:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Deletion of /opt/stack/data/nova/instances/33c2ac3e-6465-4d42-8cf8-15432abc1b53_del complete
Nov 18 15:45:18 user nova-compute[74839]: INFO nova.compute.manager [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updated VIF entry in instance network info cache for port d9a32609-d53b-4227-b209-c4c01cbb3d2b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG nova.network.neutron [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updating instance_info_cache with network_info: [{"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:45:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-50ad51f9-aa62-4406-9727-c730475869b4 req-a7c220c7-2153-4ae1-983f-2afb0d95bebb service nova] Releasing lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:45:19 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Took 0.79 seconds to deallocate network for instance.
Nov 18 15:45:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] Acquiring lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] No waiting events found dispatching network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:19 user nova-compute[74839]: WARNING nova.compute.manager [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received unexpected event network-vif-plugged-471ecda0-d7f6-4e68-946a-5b7286f0445a for instance with vm_state active and task_state deleting.
Nov 18 15:45:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-0f8d5caf-e7d7-4384-aeb3-b3ef4a3e8d6d req-0fb037b2-d35c-4978-bac6-9441a151fb7f service nova] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Received event network-vif-deleted-471ecda0-d7f6-4e68-946a-5b7286f0445a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] No waiting events found dispatching network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:20 user nova-compute[74839]: WARNING nova.compute.manager [req-bc51d7d5-99bc-4cf9-aa8a-2c65bf158826 req-92f1780e-9cd2-4946-a46e-093e7a136792 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received unexpected event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b for instance with vm_state building and task_state spawning.
Nov 18 15:45:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:20 user nova-compute[74839]: INFO nova.compute.manager [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] [instance: 33c2ac3e-6465-4d42-8cf8-15432abc1b53] Took 0.82 seconds to detach 1 volumes for instance.
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:20 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Deleted allocations for instance 33c2ac3e-6465-4d42-8cf8-15432abc1b53
Nov 18 15:45:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-76a5c802-fe1f-4fc9-9256-b6b71b2fe39a tempest-ServerActionsTestOtherB-1220678825 tempest-ServerActionsTestOtherB-1220678825-project-member] Lock "33c2ac3e-6465-4d42-8cf8-15432abc1b53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.426s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:45:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:45:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Instance spawned successfully.
Nov 18 15:45:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:45:22 user nova-compute[74839]: INFO nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:45:22 user nova-compute[74839]: INFO nova.compute.manager [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Took 6.07 seconds to build instance.
Nov 18 15:45:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-45027f3c-cdcd-4e6e-8506-e5a86e742a1f tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.167s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] No waiting events found dispatching network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:45:22 user nova-compute[74839]: WARNING nova.compute.manager [req-d7c83a95-cc41-49bf-8bb1-41ee21b9cb75 req-f73d2969-374d-491d-9529-13fccce077b6 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received unexpected event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b for instance with vm_state active and task_state None.
Nov 18 15:45:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:32 user nova-compute[74839]: INFO nova.compute.manager [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Detaching volume 03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:45:32 user nova-compute[74839]: INFO nova.virt.block_device [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Attempting to driver detach volume 03079d99-30ab-419d-a333-cd7c355d8928 from mountpoint /dev/vdb
Nov 18 15:45:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Attempting to detach device vdb from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:45:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:45:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:45:32 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:45:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:45:32 user nova-compute[74839]:   <serial>03079d99-30ab-419d-a333-cd7c355d8928</serial>
Nov 18 15:45:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 15:45:32 user nova-compute[74839]: </disk>
Nov 18 15:45:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:45:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully detached device vdb from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the persistent domain config.
Nov 18 15:45:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:45:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:45:32 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:45:32 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:45:32 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:45:32 user nova-compute[74839]:   <serial>03079d99-30ab-419d-a333-cd7c355d8928</serial>
Nov 18 15:45:32 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 15:45:32 user nova-compute[74839]: </disk>
Nov 18 15:45:32 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:45:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:45:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:44 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:45:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:45:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:49 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:49 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=25.131668090820312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f34ad603-49e5-45a2-9089-a6373aa5e9ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 24fe45b3-613e-482d-988e-f72d865571b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance b268974e-5600-42cd-bad1-b4eabf231b0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:45:49 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:45:50 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:45:50 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:45:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:45:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:45:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:53 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad is timed out.
Nov 18 15:45:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully detached device vdb from instance f34ad603-49e5-45a2-9089-a6373aa5e9ad from the live domain config.
Nov 18 15:45:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLOsYtQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:45:53 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7d9c4-d454-4700-b982-f48ec36396e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:45:53 user nova-compute[74839]: No targets found.
Nov 18 15:45:53 user nova-compute[74839]: iSNS:
Nov 18 15:45:53 user nova-compute[74839]: No targets found.
Nov 18 15:45:53 user nova-compute[74839]: STATIC:
Nov 18 15:45:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:45:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:45:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928
Nov 18 15:45:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:45:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:45:53 user nova-compute[74839]: FIRMWARE:
Nov 18 15:45:53 user nova-compute[74839]: No targets found.
Nov 18 15:45:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:45:53 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:45:53 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1492fe-ee39-458a-b134-7157d7eb9e7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c09b07-143a-4a73-a5d2-37addc357c0f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:53 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:53 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:45:53 user nova-compute[74839]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 (non-flash)
Nov 18 15:45:53 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:45:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a0137f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8eabe-66b9-45c5-9afc-45aa0ca8aa43]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f23574-f53b-4bac-8ef9-99f36a69d121]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227139c-4644-425c-9d87-0a387a7cf321]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c5f91-c58b-4118-ad60-03ab76994797]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0be06c-8884-4ce4-870a-e1902cbfd4af]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba110650-ec33-4ae1-bccc-e65485eae84e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260]
Nov 18 15:45:53 user nova-compute[74839]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928, portal: 172.16.0.220,3260] successful.
Nov 18 15:45:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03079d99-30ab-419d-a333-cd7c355d8928 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c49d1-95c9-4f42-b430-aba4ab1172a9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== disconnect_volume: return (293ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:45:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:45:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'flavor' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:45:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-faa5abb4-eb9a-485e-ba5f-6bced2f2a2a1 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:45:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:45:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:46:12 user nova-compute[74839]: INFO nova.compute.claims [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Claim successful on node user
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:46:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.policy [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a69cbda04c24c82b9d219c41bc524b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fb5852e010490a872cd924843da9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:46:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Creating image(s)
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "/opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "/opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "/opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk 1073741824" returned: 0 in 0.069s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Successfully created port: 9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Cannot resize image /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Ensure instance console log exists: /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Successfully updated port: 9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquired lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-changed-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing instance network info cache due to event network-changed-9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] Acquiring lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating instance_info_cache with network_info: [{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Releasing lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Instance network_info: |[{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] Acquired lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.neutron [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Start _get_guest_xml network_info=[{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:46:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1963006210',display_name='tempest-TestStampPattern-server-1963006210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1963006210',id=30,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-v0xkpczt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:46:14Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=262be841-6b58-4075-832e-0e67a155c4aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.objects.instance [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'pci_devices' on Instance uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:46:15 user nova-compute[74839]:   <uuid>262be841-6b58-4075-832e-0e67a155c4aa</uuid>
Nov 18 15:46:15 user nova-compute[74839]:   <name>instance-0000001e</name>
Nov 18 15:46:15 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:46:15 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:46:15 user nova-compute[74839]:   <metadata>
Nov 18 15:46:15 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:46:15 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:name>tempest-TestStampPattern-server-1963006210</nova:name>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:46:15</nova:creationTime>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:46:15 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:46:15 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:owner>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:user uuid="3a69cbda04c24c82b9d219c41bc524b4">tempest-TestStampPattern-1229984930-project-member</nova:user>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:project uuid="56fb5852e010490a872cd924843da9b7">tempest-TestStampPattern-1229984930</nova:project>
Nov 18 15:46:15 user nova-compute[74839]:       </nova:owner>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:46:15 user nova-compute[74839]:       <nova:ports>
Nov 18 15:46:15 user nova-compute[74839]:         <nova:port uuid="9a620a55-1720-40be-a227-58e69797c8b4">
Nov 18 15:46:15 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:46:15 user nova-compute[74839]:         </nova:port>
Nov 18 15:46:15 user nova-compute[74839]:       </nova:ports>
Nov 18 15:46:15 user nova-compute[74839]:     </nova:instance>
Nov 18 15:46:15 user nova-compute[74839]:   </metadata>
Nov 18 15:46:15 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:46:15 user nova-compute[74839]:     <system>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="serial">262be841-6b58-4075-832e-0e67a155c4aa</entry>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="uuid">262be841-6b58-4075-832e-0e67a155c4aa</entry>
Nov 18 15:46:15 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:46:15 user nova-compute[74839]:     </system>
Nov 18 15:46:15 user nova-compute[74839]:   </sysinfo>
Nov 18 15:46:15 user nova-compute[74839]:   <os>
Nov 18 15:46:15 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:46:15 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:46:15 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:46:15 user nova-compute[74839]:   </os>
Nov 18 15:46:15 user nova-compute[74839]:   <features>
Nov 18 15:46:15 user nova-compute[74839]:     <acpi/>
Nov 18 15:46:15 user nova-compute[74839]:     <apic/>
Nov 18 15:46:15 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:46:15 user nova-compute[74839]:   </features>
Nov 18 15:46:15 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:46:15 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:46:15 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:46:15 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:46:15 user nova-compute[74839]:   </clock>
Nov 18 15:46:15 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:46:15 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:46:15 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:46:15 user nova-compute[74839]:   </cpu>
Nov 18 15:46:15 user nova-compute[74839]:   <devices>
Nov 18 15:46:15 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:46:15 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:46:15 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk"/>
Nov 18 15:46:15 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:46:15 user nova-compute[74839]:     </disk>
Nov 18 15:46:15 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:46:15 user nova-compute[74839]:       <mac address="fa:16:3e:46:4b:0c"/>
Nov 18 15:46:15 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:46:15 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:46:15 user nova-compute[74839]:       <target dev="tap9a620a55-17"/>
Nov 18 15:46:15 user nova-compute[74839]:     </interface>
Nov 18 15:46:15 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:46:15 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/console.log" append="off"/>
Nov 18 15:46:15 user nova-compute[74839]:     </serial>
Nov 18 15:46:15 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:46:15 user nova-compute[74839]:     <video>
Nov 18 15:46:15 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:46:15 user nova-compute[74839]:     </video>
Nov 18 15:46:15 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:46:15 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:46:15 user nova-compute[74839]:     </rng>
Nov 18 15:46:15 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:46:15 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:46:15 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:46:15 user nova-compute[74839]:     </memballoon>
Nov 18 15:46:15 user nova-compute[74839]:   </devices>
Nov 18 15:46:15 user nova-compute[74839]: </domain>
Nov 18 15:46:15 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1963006210',display_name='tempest-TestStampPattern-server-1963006210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1963006210',id=30,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-v0xkpczt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:46:14Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=262be841-6b58-4075-832e-0e67a155c4aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG os_vif [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd32de2d5-de2e-5d5e-8dc3-11bbee08371b', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a620a55-17, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a620a55-17, col_values=(('qos', UUID('5f8cc29c-155a-499a-aa39-79d8dca23521')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a620a55-17, col_values=(('external_ids', {'iface-id': '9a620a55-1720-40be-a227-58e69797c8b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:4b:0c', 'vm-uuid': '262be841-6b58-4075-832e-0e67a155c4aa'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:15 user nova-compute[74839]: INFO os_vif [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17')
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No VIF found with MAC fa:16:3e:46:4b:0c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:46:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updated VIF entry in instance network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:46:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating instance_info_cache with network_info: [{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-882e08fb-be3a-4163-98b4-d734726e962f req-35af3327-1d76-4708-9934-61daaa9011cf service nova] Releasing lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] No waiting events found dispatching network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:17 user nova-compute[74839]: WARNING nova.compute.manager [req-10fccd2a-d648-4f14-af83-47956280bde1 req-c715e0f4-3055-44e8-a353-0e3d24d3e4ad service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received unexpected event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 for instance with vm_state building and task_state spawning.
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:46:19 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Instance spawned successfully.
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] No waiting events found dispatching network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:19 user nova-compute[74839]: WARNING nova.compute.manager [req-27ce1d07-7cad-427d-ac96-32137d8e893a req-fd64b382-228f-4cee-8764-94497fbe86cc service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received unexpected event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 for instance with vm_state building and task_state spawning.
Nov 18 15:46:19 user nova-compute[74839]: INFO nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 18 15:46:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:46:19 user nova-compute[74839]: INFO nova.compute.manager [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Took 6.74 seconds to build instance.
Nov 18 15:46:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-009583ee-2ee4-4de7-a12b-1ffff7ddaee5 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.844s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:46:23 user nova-compute[74839]: INFO nova.compute.claims [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Claim successful on node user
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:23 user nova-compute[74839]: INFO nova.compute.manager [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Terminating instance
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:46:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:46:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Instance destroyed successfully.
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'resources' on Instance uuid f34ad603-49e5-45a2-9089-a6373aa5e9ad {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-18T15:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1745156096',display_name='tempest-ServerActionsTestOtherA-server-796875608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1745156096',id=25,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhk4d7acTdJXX/cJeKUg+mMiGnIqpHbNy11kayBu3zHPFpH9hEJvzrZPHqoa6lA8B46MP+tgTuk9+5iAMjQup4ABCBOHspB2EMDKRY+bQGXBsvuZo9ig11m2DlnXcuWZg==',key_name='tempest-keypair-276109858',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-ox0kms16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:42:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=f34ad603-49e5-45a2-9089-a6373aa5e9ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "address": "fa:16:3e:99:50:2c", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694ae7dc-c6", "ovs_interfaceid": "694ae7dc-c6e9-4cd6-8141-4b0069246070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG os_vif [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:46:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Creating image(s)
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "/opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "/opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "/opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG nova.policy [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e7d7f55ded140ee834ec8f4126c27a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f77dd3e39e4b66acc27cd4aa4d78fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap694ae7dc-c6, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22bb57bd-0179-450f-aa9a-a9d7fcce8fb1) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:46:24 user nova-compute[74839]: INFO os_vif [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=694ae7dc-c6e9-4cd6-8141-4b0069246070,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694ae7dc-c6')
Nov 18 15:46:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Deleting instance files /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad_del
Nov 18 15:46:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Deletion of /opt/stack/data/nova/instances/f34ad603-49e5-45a2-9089-a6373aa5e9ad_del complete
Nov 18 15:46:24 user nova-compute[74839]: INFO nova.compute.manager [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk 1073741824" returned: 0 in 0.058s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-changed-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Refreshing instance network info cache due to event network-changed-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] Acquiring lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] Acquired lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.network.neutron [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Refreshing network info cache for port 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Cannot resize image /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Ensure instance console log exists: /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:24 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Successfully created port: 24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updated VIF entry in instance network info cache for port 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating instance_info_cache with network_info: [{"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-100da953-7d40-4d95-8a95-eb0c40224448 req-36d89447-1221-4d99-91a4-0e12e01feaad service nova] Releasing lock "refresh_cache-6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:25 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Took 1.41 seconds to deallocate network for instance.
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.compute.manager [req-8a376f0d-0427-446a-8cd3-92ed98229abc req-34c64a58-132f-4182-a9cc-19fb7190330f service nova] [instance: f34ad603-49e5-45a2-9089-a6373aa5e9ad] Received event network-vif-deleted-694ae7dc-c6e9-4cd6-8141-4b0069246070 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Successfully updated port: 24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.objects.instance [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquired lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:25 user nova-compute[74839]: INFO nova.compute.manager [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attaching volume bb392ca6-9c97-428f-9f16-2bfeaca0d7bc to /dev/vdb
Nov 18 15:46:25 user nova-compute[74839]: DEBUG os_brick.utils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e639e960-f02f-4092-affa-ba05a33d9fb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e1e518-1306-4f40-a44a-60710d8405d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updating instance_info_cache with network_info: [{"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7494e537-e7da-49d9-85ea-fcbacea8ec74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Releasing lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Instance network_info: |[{"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ddf1c-b87d-475f-ab6c-e7cde67b971b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Start _get_guest_xml network_info=[{"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:46:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:26 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:26 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:46:26 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ba413-da8d-46fc-90d4-7146d8d84d0c]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG os_brick.utils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating existing volume attachment record: 979394e9-757c-4107-91ef-b9c4d8f2be91 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-692908807',display_name='tempest-ServersNegativeTestJSON-server-692908807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-692908807',id=31,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-uzyytpp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:46:24Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=52e37fef-6ad5-49c9-a334-d40249b06ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lazy-loading 'pci_devices' on Instance uuid 52e37fef-6ad5-49c9-a334-d40249b06ea3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:46:26 user nova-compute[74839]:   <uuid>52e37fef-6ad5-49c9-a334-d40249b06ea3</uuid>
Nov 18 15:46:26 user nova-compute[74839]:   <name>instance-0000001f</name>
Nov 18 15:46:26 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:46:26 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:46:26 user nova-compute[74839]:   <metadata>
Nov 18 15:46:26 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:46:26 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:name>tempest-ServersNegativeTestJSON-server-692908807</nova:name>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:46:26</nova:creationTime>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:46:26 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:46:26 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:owner>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:user uuid="7e7d7f55ded140ee834ec8f4126c27a1">tempest-ServersNegativeTestJSON-1785706841-project-member</nova:user>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:project uuid="36f77dd3e39e4b66acc27cd4aa4d78fe">tempest-ServersNegativeTestJSON-1785706841</nova:project>
Nov 18 15:46:26 user nova-compute[74839]:       </nova:owner>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:46:26 user nova-compute[74839]:       <nova:ports>
Nov 18 15:46:26 user nova-compute[74839]:         <nova:port uuid="24e48126-6867-443d-8420-f63dfe60f569">
Nov 18 15:46:26 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:46:26 user nova-compute[74839]:         </nova:port>
Nov 18 15:46:26 user nova-compute[74839]:       </nova:ports>
Nov 18 15:46:26 user nova-compute[74839]:     </nova:instance>
Nov 18 15:46:26 user nova-compute[74839]:   </metadata>
Nov 18 15:46:26 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:46:26 user nova-compute[74839]:     <system>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="serial">52e37fef-6ad5-49c9-a334-d40249b06ea3</entry>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="uuid">52e37fef-6ad5-49c9-a334-d40249b06ea3</entry>
Nov 18 15:46:26 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:46:26 user nova-compute[74839]:     </system>
Nov 18 15:46:26 user nova-compute[74839]:   </sysinfo>
Nov 18 15:46:26 user nova-compute[74839]:   <os>
Nov 18 15:46:26 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:46:26 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:46:26 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:46:26 user nova-compute[74839]:   </os>
Nov 18 15:46:26 user nova-compute[74839]:   <features>
Nov 18 15:46:26 user nova-compute[74839]:     <acpi/>
Nov 18 15:46:26 user nova-compute[74839]:     <apic/>
Nov 18 15:46:26 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:46:26 user nova-compute[74839]:   </features>
Nov 18 15:46:26 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:46:26 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:46:26 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:46:26 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:46:26 user nova-compute[74839]:   </clock>
Nov 18 15:46:26 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:46:26 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:46:26 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:46:26 user nova-compute[74839]:   </cpu>
Nov 18 15:46:26 user nova-compute[74839]:   <devices>
Nov 18 15:46:26 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:46:26 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:46:26 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk"/>
Nov 18 15:46:26 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:46:26 user nova-compute[74839]:     </disk>
Nov 18 15:46:26 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:46:26 user nova-compute[74839]:       <mac address="fa:16:3e:8f:26:f7"/>
Nov 18 15:46:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:46:26 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:46:26 user nova-compute[74839]:       <target dev="tap24e48126-68"/>
Nov 18 15:46:26 user nova-compute[74839]:     </interface>
Nov 18 15:46:26 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:46:26 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/console.log" append="off"/>
Nov 18 15:46:26 user nova-compute[74839]:     </serial>
Nov 18 15:46:26 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:46:26 user nova-compute[74839]:     <video>
Nov 18 15:46:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:46:26 user nova-compute[74839]:     </video>
Nov 18 15:46:26 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:46:26 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:46:26 user nova-compute[74839]:     </rng>
Nov 18 15:46:26 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:46:26 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:46:26 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:46:26 user nova-compute[74839]:     </memballoon>
Nov 18 15:46:26 user nova-compute[74839]:   </devices>
Nov 18 15:46:26 user nova-compute[74839]: </domain>
Nov 18 15:46:26 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-692908807',display_name='tempest-ServersNegativeTestJSON-server-692908807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-692908807',id=31,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-uzyytpp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:46:24Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=52e37fef-6ad5-49c9-a334-d40249b06ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG os_vif [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2efabe1-b476-5a02-ace3-64fd8d1404da', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e48126-68, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24e48126-68, col_values=(('qos', UUID('ad61c9ed-3c02-4b13-a1e9-af2c9f81a6b2')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24e48126-68, col_values=(('external_ids', {'iface-id': '24e48126-6867-443d-8420-f63dfe60f569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:26:f7', 'vm-uuid': '52e37fef-6ad5-49c9-a334-d40249b06ea3'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:26 user nova-compute[74839]: INFO os_vif [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68')
Nov 18 15:46:26 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Deleted allocations for instance f34ad603-49e5-45a2-9089-a6373aa5e9ad
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] No VIF found with MAC fa:16:3e:8f:26:f7, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e9d696bd-96f0-48d6-abef-c3783250c581 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "f34ad603-49e5-45a2-9089-a6373aa5e9ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.113s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-changed-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Refreshing instance network info cache due to event network-changed-24e48126-6867-443d-8420-f63dfe60f569. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] Acquiring lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] Acquired lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:26 user nova-compute[74839]: DEBUG nova.network.neutron [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Refreshing network info cache for port 24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updated VIF entry in instance network info cache for port 24e48126-6867-443d-8420-f63dfe60f569. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updating instance_info_cache with network_info: [{"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-480f993b-33ad-473d-bcd4-4e93276944d1 req-c21b22df-1728-4ca0-b082-13d86dd81830 service nova] Releasing lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] No waiting events found dispatching network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:27 user nova-compute[74839]: WARNING nova.compute.manager [req-1236d77b-e545-48aa-b986-b3c112fa7800 req-8ccbd1ca-53b8-464f-908e-e630dd0878ba service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received unexpected event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 for instance with vm_state building and task_state spawning.
Nov 18 15:46:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:46:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Instance spawned successfully.
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:46:29 user nova-compute[74839]: INFO nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] No waiting events found dispatching network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:29 user nova-compute[74839]: WARNING nova.compute.manager [req-87a94adc-62cc-40a4-bd5f-419aa2fe695e req-08ed99ed-3b02-4072-aaf2-9b533a8e5e41 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received unexpected event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 for instance with vm_state building and task_state spawning.
Nov 18 15:46:29 user nova-compute[74839]: INFO nova.compute.manager [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Took 6.87 seconds to build instance.
Nov 18 15:46:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c08de219-e5e9-4634-bd2a-364df6b99d73 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:31 user nova-compute[74839]: INFO nova.compute.manager [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Unrescuing
Nov 18 15:46:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG nova.network.neutron [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG nova.objects.instance [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'flavor' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:32 user nova-compute[74839]: WARNING nova.compute.manager [req-4689ab6d-1654-4357-9ec2-0a7c221a1ee0 req-18810327-5a4a-4a45-9e03-c3c56838b73d service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-unplugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance destroyed successfully.
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:34 user nova-compute[74839]: WARNING nova.compute.manager [req-cee7d792-5dd8-40a5-bb34-421b4a374e10 req-f7a83676-92d8-41e2-9b8c-1a4b6c559b51 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:36 user nova-compute[74839]: WARNING nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] No waiting events found dispatching network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:36 user nova-compute[74839]: WARNING nova.compute.manager [req-ea1e1c11-5984-4023-a480-75d6e961332d req-156de567-c3a5-410d-9caf-e991e2b23d8b service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received unexpected event network-vif-plugged-bac9dbee-a574-4473-afa0-4c6838c60212 for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-bc628408-bfc5-4efe-90c8-99852a26090a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykvTlGLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:46:38 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:46:38 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:46:38 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d8234-48e6-4f41-8ebb-a7a75a70d133]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:46:38 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb0cd6-88ea-404f-ad63-a92298bcc680]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc] added
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f0153-fe3c-49af-9912-7ab25e1a31db]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce432cc-5a48-436c-bbb0-ebd6d7304718]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykvTlGLd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ykvTlGLd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829cccd-bf78-42d6-acda-0d712e584443]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ykvTlGLd'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3733152-9aa3-4898-a84f-2ba6b5d25e5a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce7a39-9f35-4dae-a0b4-d449943703fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835fd88-0dbe-426b-98ef-2339c91c22dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260]
Nov 18 15:46:38 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260] successful.
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b35229-c4bf-45bb-b780-b8f2dcd62cdf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[381503df-1972-4d58-8fc8-66e543293e46]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:38 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e7a014-c332-48bc-9d04-baa0f47721de]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:46:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykvTlGLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23565646137626264', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565646137626264', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:46:39 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:46:39 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:46:39 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:46:39 user nova-compute[74839]:   <serial>bb392ca6-9c97-428f-9f16-2bfeaca0d7bc</serial>
Nov 18 15:46:39 user nova-compute[74839]: </disk>
Nov 18 15:46:39 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:46:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No VIF found with MAC fa:16:3e:c5:f4:e7, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:46:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-545de911-5d7a-4eaa-ac48-2bc788612837 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.460s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:45 user nova-compute[74839]: INFO nova.compute.manager [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attaching volume 3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 to /dev/vdc
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.utils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af4e118-4b55-4109-9c7c-b7dc0b0b6225]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[957adf14-dccd-459d-8456-27709bef59b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4f9ae-dbd9-476e-9cd1-a15c3f08019f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5dac7-6ad4-4a75-bf58-2639d91dabbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:46:45 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07644374-e316-4fba-9267-30071b70f213]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG os_brick.utils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating existing volume attachment record: bc20bb8d-ccf4-4e40-8e1d-d4c386302a0e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:46:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:49 user nova-compute[74839]: INFO nova.compute.manager [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Unrescuing
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquired lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [{"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Releasing lock "refresh_cache-24fe45b3-613e-482d-988e-f72d865571b8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'flavor' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:50 user nova-compute[74839]: WARNING nova.compute.manager [req-3d0bb53b-4fdb-400e-a98b-93840f352714 req-2cab3ab0-e61d-4ca4-95b0-34d64b0d78aa service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance destroyed successfully.
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvOtjiPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:46:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:46:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:46:51 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[42111f9e-0c57-43ba-9cd2-83742f1fd0c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:46:51 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bc7fb1-63cf-46b2-a07f-b3c47314b504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495] added
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18bb143-756f-4e6d-b16e-37c41d8ed462]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e827c-6e74-434b-8b84-1228be90366d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvOtjiPW {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvOtjiPW" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3a4609-90f9-4e9e-a8fc-eb99d68de8ee]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvOtjiPW'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d142642-8564-4c90-9e70-951e88d23046]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8227d67-8bd7-4520-9d96-ccb3f6ecb910]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f1649b-0fca-4db6-91a1-10dfed999c79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260]
Nov 18 15:46:51 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260] successful.
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb2f92-9ec1-4992-8b9b-382e91ab02df]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8690bf1-5be2-413c-903b-5f6f2d425638]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:46:51 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:46:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb9bcf-f58b-4a20-afb4-c857651c31d6]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:46:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvOtjiPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23363613339356331', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363613339356331', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:46:52 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:46:52 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:46:52 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 15:46:52 user nova-compute[74839]:   <serial>3f293a2b-ea4b-4d1b-82cf-a62a18ae9495</serial>
Nov 18 15:46:52 user nova-compute[74839]: </disk>
Nov 18 15:46:52 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:52 user nova-compute[74839]: WARNING nova.compute.manager [req-5dbc1c12-7132-46b8-ae53-c8e6242e385f req-4ac8139b-c813-4d1a-9a28-2b54e91b94d0 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] No VIF found with MAC fa:16:3e:c5:f4:e7, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:46:53 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:53 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.0799560546875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4c0273a8-3084-4268-b790-82c0a01a2d2b tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.820s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 24fe45b3-613e-482d-988e-f72d865571b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance b268974e-5600-42cd-bad1-b4eabf231b0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:46:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:54 user nova-compute[74839]: WARNING nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:46:54 user nova-compute[74839]: WARNING nova.compute.manager [req-1cb8d394-268d-4745-93b2-b1f67d4b01c5 req-22446fad-5469-42a6-a0fb-a2c008350d95 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:46:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b7de15d9-2298-49d1-80c6-c5a7965ccdfe tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:46:55 user nova-compute[74839]: INFO nova.compute.manager [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Detaching volume 3f293a2b-ea4b-4d1b-82cf-a62a18ae9495
Nov 18 15:46:55 user nova-compute[74839]: INFO nova.virt.block_device [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attempting to driver detach volume 3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 from mountpoint /dev/vdc
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Attempting to detach device vdc from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:46:55 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:46:55 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:46:55 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 15:46:55 user nova-compute[74839]:   <serial>3f293a2b-ea4b-4d1b-82cf-a62a18ae9495</serial>
Nov 18 15:46:55 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 15:46:55 user nova-compute[74839]: </disk>
Nov 18 15:46:55 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:46:55 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully detached device vdc from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the persistent domain config.
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:46:55 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:46:55 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:46:55 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 15:46:55 user nova-compute[74839]:   <serial>3f293a2b-ea4b-4d1b-82cf-a62a18ae9495</serial>
Nov 18 15:46:55 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 15:46:55 user nova-compute[74839]: </disk>
Nov 18 15:46:55 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:46:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:46:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-changed-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Refreshing instance network info cache due to event network-changed-d9a32609-d53b-4227-b209-c4c01cbb3d2b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] Acquiring lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] Acquired lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Refreshing network info cache for port d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updated VIF entry in instance network info cache for port d9a32609-d53b-4227-b209-c4c01cbb3d2b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updating instance_info_cache with network_info: [{"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:47:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bab0c845-1516-4114-b02c-ad83292f889c req-83ebe594-714c-41d9-8e94-90a00e850dff service nova] Releasing lock "refresh_cache-b268974e-5600-42cd-bad1-b4eabf231b0d" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:08 user nova-compute[74839]: INFO nova.compute.manager [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Attaching volume 4780bbd9-0444-4392-a500-8f0583305331 to /dev/vdb
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.utils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a19144-4eb6-4422-99d7-791d07ecaa49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[897cb455-1ad3-4bdf-9090-cb249bf80b77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[80015029-778d-4942-be2f-88f02d23b09e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8840ee1a-4ca5-46e7-8b33-a2edff4d3c40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:47:08 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:47:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c76cd90-9f63-49bf-88a1-0d93a7bd3725]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG os_brick.utils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:47:08 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updating existing volume attachment record: b07a59fa-9df1-4f77-ad88-4de7ff0f9e6d {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:47:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkESABgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:47:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:47:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:47:14 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24e21e7-5f10-4a43-a9b1-d676c52ab7f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:47:14 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59c218-9172-4b34-8ff7-0f4d7b176d0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331] added
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aeae98-8cc1-4a36-ac9f-db7e7a88e4c0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2605b8e-e7fe-4830-8401-401e81708553]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkESABgK {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkESABgK" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2039f73-b284-493f-8078-4cacf55b69a1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zkESABgK'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04dfce2-f0bd-44fe-b550-12f71c54eaa0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d819ec1-8568-4825-ac8c-6632e0710b74]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93b4dff-9dc4-4816-a198-24a0711c08ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260]
Nov 18 15:47:14 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260] successful.
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6971c71-5fbe-466b-9fa6-dc797d9f36d6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e81be3-0415-4732-bcf4-1be6d149e20f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0b1ef-6a34-44d4-805d-c8fccd5bd5c6]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:47:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkESABgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 is timed out.
Nov 18 15:47:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully detached device vdc from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the live domain config.
Nov 18 15:47:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvOtjiPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:47:15 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23033633538366436', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633538366436', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.105s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG nova.objects.instance [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab976deb-1e79-426c-80b2-db2830e2e583]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:47:15 user nova-compute[74839]: No targets found.
Nov 18 15:47:15 user nova-compute[74839]: iSNS:
Nov 18 15:47:15 user nova-compute[74839]: No targets found.
Nov 18 15:47:15 user nova-compute[74839]: STATIC:
Nov 18 15:47:15 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:47:15 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:15 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:15 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:47:15 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:15 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:15 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc
Nov 18 15:47:15 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:15 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:15 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495
Nov 18 15:47:15 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:15 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:15 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331
Nov 18 15:47:15 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:15 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:15 user nova-compute[74839]: FIRMWARE:
Nov 18 15:47:15 user nova-compute[74839]: No targets found.
Nov 18 15:47:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:47:15 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:47:15 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:47:15 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:47:15 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 15:47:15 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:47:15 user nova-compute[74839]:   <serial>4780bbd9-0444-4392-a500-8f0583305331</serial>
Nov 18 15:47:15 user nova-compute[74839]: </disk>
Nov 18 15:47:15 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d241e15b-2737-4e1b-a45d-8c1872c03a44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f132fb-85fa-43da-9fc6-7a4b6764759e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801ea7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82fda03-6a3c-455a-a378-ec55ab6cb211]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bcedff-5980-491b-b5ac-57c6d0d14597]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa17fbca-26ee-4fe1-8cdf-b72b4040a197]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f42877f-595e-4a0d-9328-06ed457fded2]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cf26a6-4f5e-42e2-a192-42c1f490f15a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18634bb3-77f2-4527-a4a1-d7bd6aca9fcb]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260]
Nov 18 15:47:15 user nova-compute[74839]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495, portal: 172.16.0.220,3260] successful.
Nov 18 15:47:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f293a2b-ea4b-4d1b-82cf-a62a18ae9495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29dbb83-e72f-4fec-aa6e-f69c19cdca8d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== disconnect_volume: return (412ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] No VIF found with MAC fa:16:3e:34:0f:a6, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-21bd62cf-bbe6-4b29-b353-fbdba7c3558d tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.510s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:47:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-38740fba-8ef1-4396-8ac3-55e3254d7983 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:17 user nova-compute[74839]: INFO nova.compute.manager [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Detaching volume 4780bbd9-0444-4392-a500-8f0583305331
Nov 18 15:47:17 user nova-compute[74839]: INFO nova.virt.block_device [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Attempting to driver detach volume 4780bbd9-0444-4392-a500-8f0583305331 from mountpoint /dev/vdb
Nov 18 15:47:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Attempting to detach device vdb from instance b268974e-5600-42cd-bad1-b4eabf231b0d from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:47:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:47:17 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:47:17 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 15:47:17 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:47:17 user nova-compute[74839]:   <serial>4780bbd9-0444-4392-a500-8f0583305331</serial>
Nov 18 15:47:17 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:47:17 user nova-compute[74839]: </disk>
Nov 18 15:47:17 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:47:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance b268974e-5600-42cd-bad1-b4eabf231b0d from the persistent domain config.
Nov 18 15:47:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b268974e-5600-42cd-bad1-b4eabf231b0d from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:47:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:47:17 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:47:17 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 15:47:17 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:47:17 user nova-compute[74839]:   <serial>4780bbd9-0444-4392-a500-8f0583305331</serial>
Nov 18 15:47:17 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:47:17 user nova-compute[74839]: </disk>
Nov 18 15:47:17 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:47:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:47:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:33 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:47:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:47:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:47:38 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b268974e-5600-42cd-bad1-b4eabf231b0d is timed out.
Nov 18 15:47:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully detached device vdb from instance b268974e-5600-42cd-bad1-b4eabf231b0d from the live domain config.
Nov 18 15:47:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkESABgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:47:38 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414b9bd-4073-427b-9825-a0dd6437e6b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:47:38 user nova-compute[74839]: No targets found.
Nov 18 15:47:38 user nova-compute[74839]: iSNS:
Nov 18 15:47:38 user nova-compute[74839]: No targets found.
Nov 18 15:47:38 user nova-compute[74839]: STATIC:
Nov 18 15:47:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:47:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:47:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc
Nov 18 15:47:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:38 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331
Nov 18 15:47:38 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:47:38 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:47:38 user nova-compute[74839]: FIRMWARE:
Nov 18 15:47:38 user nova-compute[74839]: No targets found.
Nov 18 15:47:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:47:38 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:47:38 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e877038-d737-4551-aafb-9576617054e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d4f84-e256-4833-976c-42dd88874440]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:47:38 user nova-compute[74839]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 (non-flash)
Nov 18 15:47:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480465d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450ef05-331f-48ab-bcb0-70b188e15b1a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce40ae0-0af0-4c8e-98c0-e128d65ef537]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[853310e1-5465-47a5-a9cc-07b4cc153e23]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a6240-993c-4aa7-b17e-64038ce7fea1]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5aed7d-695e-46a0-9708-746952366836]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90cea78-5753-44c3-a1e8-564d20b1d31c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260]
Nov 18 15:47:38 user nova-compute[74839]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331, portal: 172.16.0.220,3260] successful.
Nov 18 15:47:38 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4780bbd9-0444-4392-a500-8f0583305331 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff3511-0825-4467-ac4c-82a27a8c60a9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] <== disconnect_volume: return (307ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:47:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:47:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'flavor' on Instance uuid b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:47:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-17b0cd6e-656a-46a2-8110-81e732807298 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.639s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:42 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:44 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updating instance_info_cache with network_info: [{"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:47:45 user nova-compute[74839]: INFO nova.compute.manager [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Detaching volume bb392ca6-9c97-428f-9f16-2bfeaca0d7bc
Nov 18 15:47:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-13975a6d-cb76-4a2d-9174-4427522bdbf8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:47:45 user nova-compute[74839]: INFO nova.virt.block_device [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Attempting to driver detach volume bb392ca6-9c97-428f-9f16-2bfeaca0d7bc from mountpoint /dev/vdb
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Attempting to detach device vdb from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:47:45 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:47:45 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:47:45 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:47:45 user nova-compute[74839]:   <serial>bb392ca6-9c97-428f-9f16-2bfeaca0d7bc</serial>
Nov 18 15:47:45 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:47:45 user nova-compute[74839]: </disk>
Nov 18 15:47:45 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:47:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully detached device vdb from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the persistent domain config.
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:47:45 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:47:45 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:47:45 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:47:45 user nova-compute[74839]:   <serial>bb392ca6-9c97-428f-9f16-2bfeaca0d7bc</serial>
Nov 18 15:47:45 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:47:45 user nova-compute[74839]: </disk>
Nov 18 15:47:45 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:47:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:47:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:48 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:47:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:47:53 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:47:53 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=25.07628631591797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 24fe45b3-613e-482d-988e-f72d865571b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance b268974e-5600-42cd-bad1-b4eabf231b0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:47:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:47:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:47:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-changed-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing instance network info cache due to event network-changed-9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:48:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] Acquiring lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] Acquired lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG nova.network.neutron [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updated VIF entry in instance network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG nova.network.neutron [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating instance_info_cache with network_info: [{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-75d3e3d8-e87e-464c-934b-a1e8ecb89f27 req-81c27230-2a3d-4c0b-bf2d-472767e35a05 service nova] Releasing lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG nova.objects.instance [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:05 user nova-compute[74839]: INFO nova.compute.manager [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Attaching volume b94d2dc6-5675-4f41-867b-803d96ed86e7 to /dev/vdb
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.utils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42a5d2-370b-463e-b707-0343888e5430]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b710d4f-2377-4af4-942e-f027fbf282a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b8404e-fc18-498a-b808-440c0914b632]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[396208a6-561a-4b8b-9758-93d76b2c029e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:48:05 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:48:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab858b1-82b1-466d-b81b-f2d876d1aae2]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG os_brick.utils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:05 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating existing volume attachment record: fafe4359-ed81-4633-8d02-1b45049a83a4 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:48:05 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 is timed out.
Nov 18 15:48:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully detached device vdb from instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 from the live domain config.
Nov 18 15:48:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ykvTlGLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:06 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[367bd92f-9c95-4719-867a-45766412d1cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:48:06 user nova-compute[74839]: No targets found.
Nov 18 15:48:06 user nova-compute[74839]: iSNS:
Nov 18 15:48:06 user nova-compute[74839]: No targets found.
Nov 18 15:48:06 user nova-compute[74839]: STATIC:
Nov 18 15:48:06 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:48:06 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:06 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:06 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:48:06 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:06 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:06 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc
Nov 18 15:48:06 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:06 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:06 user nova-compute[74839]: FIRMWARE:
Nov 18 15:48:06 user nova-compute[74839]: No targets found.
Nov 18 15:48:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:48:06 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:48:06 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d98d1-3f82-46ae-8b44-93260ba3a8c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a3b55-90e9-45ea-91f1-df08da477dbb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:06 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:06 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:48:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:06 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:06 user nova-compute[74839]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc (non-flash)
Nov 18 15:48:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480514670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e452f2a-3c14-4160-a671-2d608633e0ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa398ab3-c260-4597-bbe9-74fa3519d8e7]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb96825-0a2d-45b5-ad3e-1a33d1464b0c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd46c6b-e335-4e21-a708-01f2ebd8d92d]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f0da7c-d330-455e-8d92-2a278c494a74]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca474700-7697-4175-974b-07f0a219b57d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260]
Nov 18 15:48:06 user nova-compute[74839]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc, portal: 172.16.0.220,3260] successful.
Nov 18 15:48:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb392ca6-9c97-428f-9f16-2bfeaca0d7bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcee48a6-95f5-4584-a19f-7c27454f5cb4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] <== disconnect_volume: return (293ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'flavor' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6c3ca037-597d-4520-805a-591a40afbcc7 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.581s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:07 user nova-compute[74839]: INFO nova.compute.manager [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Terminating instance
Nov 18 15:48:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-unplugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] No waiting events found dispatching network-vif-unplugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-d88abb34-7549-47fc-8bdf-e131db66dc42 req-85e30b0a-90a5-4b8d-b742-a4bf67aa4a72 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-unplugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:48:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Instance destroyed successfully.
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lazy-loading 'resources' on Instance uuid b268974e-5600-42cd-bad1-b4eabf231b0d {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1012458988',display_name='tempest-AttachVolumeNegativeTest-server-1012458988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1012458988',id=29,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJeL9KeETGGwji1v9w7xNJqNw2kUyNZeZAY4Qh0lzQg1SbNLzHGjN68ZDZp8unYJNd7JMun5gA8oAquNiDB6I+euTuND7PQDW0sGNdy0kj8Sctct/czxXLz0EmunFK8bQ==',key_name='tempest-keypair-858234225',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d67202285b746fb80c72ae0d42394d5',ramdisk_id='',reservation_id='r-1hgr6afv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-183955382',owner_user_name='tempest-AttachVolumeNegativeTest-183955382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:45:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd5091855f2647abba05a98492302656',uuid=b268974e-5600-42cd-bad1-b4eabf231b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converting VIF {"id": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "address": "fa:16:3e:34:0f:a6", "network": {"id": "1a6b65ac-177c-47bd-b50d-efe6f1b8d349", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1825959823-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d67202285b746fb80c72ae0d42394d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9a32609-d5", "ovs_interfaceid": "d9a32609-d53b-4227-b209-c4c01cbb3d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG os_vif [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9a32609-d5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677cfb44-f4b2-4bce-95f6-c3220532383e) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:08 user nova-compute[74839]: INFO os_vif [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:0f:a6,bridge_name='br-int',has_traffic_filtering=True,id=d9a32609-d53b-4227-b209-c4c01cbb3d2b,network=Network(1a6b65ac-177c-47bd-b50d-efe6f1b8d349),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9a32609-d5')
Nov 18 15:48:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Deleting instance files /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d_del
Nov 18 15:48:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Deletion of /opt/stack/data/nova/instances/b268974e-5600-42cd-bad1-b4eabf231b0d_del complete
Nov 18 15:48:08 user nova-compute[74839]: INFO nova.compute.manager [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 15:48:08 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:48:08 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:09 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Took 0.74 seconds to deallocate network for instance.
Nov 18 15:48:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-bfdbe3d1-e3cd-4f0d-aaef-20fc7ba662c7 req-eb46cef3-0910-4b66-912a-a9ff21e28c57 service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-deleted-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:10 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Deleted allocations for instance b268974e-5600-42cd-bad1-b4eabf231b0d
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a1e7bf36-af3e-469c-affb-84e3788dc2d1 tempest-AttachVolumeNegativeTest-183955382 tempest-AttachVolumeNegativeTest-183955382-project-member] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] Acquiring lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] Lock "b268974e-5600-42cd-bad1-b4eabf231b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] No waiting events found dispatching network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:10 user nova-compute[74839]: WARNING nova.compute.manager [req-d3f84568-0ae4-422d-8fa7-0f2674ba5c38 req-7db47832-46d9-47db-8a44-5131db54023e service nova] [instance: b268974e-5600-42cd-bad1-b4eabf231b0d] Received unexpected event network-vif-plugged-d9a32609-d53b-4227-b209-c4c01cbb3d2b for instance with vm_state deleted and task_state None.
Nov 18 15:48:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqvBLIFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:10 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:10 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:10 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ecd79-34e3-45ee-89bf-c7a16270e9ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:48:10 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fefaaad-ac2d-49bd-99ee-e193d39c17b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7] added
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78564d5a-274d-440f-abfe-88ee97e1c477]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cebf648-7f44-4070-8368-cc06a4063b0e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqvBLIFS {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqvBLIFS" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1986d0-ea8b-4510-8c3e-9dbc6562f747]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqvBLIFS'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1a8ab-67db-4210-8eb4-bcb4b459d105]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29bc42c-b5d2-43f5-981d-daf6e4832894]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b6629-f71d-45a5-9736-89548592dccb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260]
Nov 18 15:48:10 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260] successful.
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46520429-73fc-4742-a9f0-26683ced9c33]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0609cb3f-0c18-429d-a017-4728cc8d49ea]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:10 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:48:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a78ede-a523-41fe-b620-ccd3bd099f37]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:48:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqvBLIFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23932623530346665', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932623530346665', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.objects.instance [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:48:12 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:48:12 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:48:12 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:48:12 user nova-compute[74839]:   <serial>b94d2dc6-5675-4f41-867b-803d96ed86e7</serial>
Nov 18 15:48:12 user nova-compute[74839]: </disk>
Nov 18 15:48:12 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No VIF found with MAC fa:16:3e:46:4b:0c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:48:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-56ef1bfb-f089-42f4-87b9-5191f962d1ef tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.345s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.compute.claims [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Claim successful on node user
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.compute.manager [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Detaching volume b94d2dc6-5675-4f41-867b-803d96ed86e7
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.policy [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e7d7f55ded140ee834ec8f4126c27a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f77dd3e39e4b66acc27cd4aa4d78fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.virt.block_device [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Attempting to driver detach volume b94d2dc6-5675-4f41-867b-803d96ed86e7 from mountpoint /dev/vdb
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Attempting to detach device vdb from instance 262be841-6b58-4075-832e-0e67a155c4aa from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:48:14 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:48:14 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:48:14 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:48:14 user nova-compute[74839]:   <serial>b94d2dc6-5675-4f41-867b-803d96ed86e7</serial>
Nov 18 15:48:14 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:48:14 user nova-compute[74839]: </disk>
Nov 18 15:48:14 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully detached device vdb from instance 262be841-6b58-4075-832e-0e67a155c4aa from the persistent domain config.
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 262be841-6b58-4075-832e-0e67a155c4aa from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:48:14 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:48:14 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:48:14 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:48:14 user nova-compute[74839]:   <serial>b94d2dc6-5675-4f41-867b-803d96ed86e7</serial>
Nov 18 15:48:14 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:48:14 user nova-compute[74839]: </disk>
Nov 18 15:48:14 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:48:14 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Creating image(s)
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "/opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "/opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.218s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Successfully created port: ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk 1073741824" returned: 0 in 0.057s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Cannot resize image /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Ensure instance console log exists: /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:15 user nova-compute[74839]: WARNING nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid df4b8778-e410-4771-99f8-eefb3aeb39d2 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 13975a6d-cb76-4a2d-9174-4427522bdbf8 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 52e37fef-6ad5-49c9-a334-d40249b06ea3 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid cd8c15a1-13ba-43e8-a323-f59795539bd3 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "24fe45b3-613e-482d-988e-f72d865571b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Successfully updated port: ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "24fe45b3-613e-482d-988e-f72d865571b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquired lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-changed-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Refreshing instance network info cache due to event network-changed-ac0ae888-bba5-4903-ad16-b13fb8f1afd8. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] Acquiring lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:15 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Updating instance_info_cache with network_info: [{"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Releasing lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Instance network_info: |[{"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] Acquired lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Refreshing network info cache for port ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Start _get_guest_xml network_info=[{"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:48:16 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:16 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-418205984',display_name='tempest-ServersNegativeTestJSON-server-418205984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-418205984',id=32,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-4vkdeu28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:15Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=cd8c15a1-13ba-43e8-a323-f59795539bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lazy-loading 'pci_devices' on Instance uuid cd8c15a1-13ba-43e8-a323-f59795539bd3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:48:16 user nova-compute[74839]:   <uuid>cd8c15a1-13ba-43e8-a323-f59795539bd3</uuid>
Nov 18 15:48:16 user nova-compute[74839]:   <name>instance-00000020</name>
Nov 18 15:48:16 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:48:16 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:48:16 user nova-compute[74839]:   <metadata>
Nov 18 15:48:16 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:48:16 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:name>tempest-ServersNegativeTestJSON-server-418205984</nova:name>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:48:16</nova:creationTime>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:48:16 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:48:16 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:owner>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:user uuid="7e7d7f55ded140ee834ec8f4126c27a1">tempest-ServersNegativeTestJSON-1785706841-project-member</nova:user>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:project uuid="36f77dd3e39e4b66acc27cd4aa4d78fe">tempest-ServersNegativeTestJSON-1785706841</nova:project>
Nov 18 15:48:16 user nova-compute[74839]:       </nova:owner>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:48:16 user nova-compute[74839]:       <nova:ports>
Nov 18 15:48:16 user nova-compute[74839]:         <nova:port uuid="ac0ae888-bba5-4903-ad16-b13fb8f1afd8">
Nov 18 15:48:16 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 15:48:16 user nova-compute[74839]:         </nova:port>
Nov 18 15:48:16 user nova-compute[74839]:       </nova:ports>
Nov 18 15:48:16 user nova-compute[74839]:     </nova:instance>
Nov 18 15:48:16 user nova-compute[74839]:   </metadata>
Nov 18 15:48:16 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:48:16 user nova-compute[74839]:     <system>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="serial">cd8c15a1-13ba-43e8-a323-f59795539bd3</entry>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="uuid">cd8c15a1-13ba-43e8-a323-f59795539bd3</entry>
Nov 18 15:48:16 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:48:16 user nova-compute[74839]:     </system>
Nov 18 15:48:16 user nova-compute[74839]:   </sysinfo>
Nov 18 15:48:16 user nova-compute[74839]:   <os>
Nov 18 15:48:16 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:48:16 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:48:16 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:48:16 user nova-compute[74839]:   </os>
Nov 18 15:48:16 user nova-compute[74839]:   <features>
Nov 18 15:48:16 user nova-compute[74839]:     <acpi/>
Nov 18 15:48:16 user nova-compute[74839]:     <apic/>
Nov 18 15:48:16 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:48:16 user nova-compute[74839]:   </features>
Nov 18 15:48:16 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:48:16 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:48:16 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:48:16 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:48:16 user nova-compute[74839]:   </clock>
Nov 18 15:48:16 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:48:16 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:48:16 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:48:16 user nova-compute[74839]:   </cpu>
Nov 18 15:48:16 user nova-compute[74839]:   <devices>
Nov 18 15:48:16 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:48:16 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:48:16 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk"/>
Nov 18 15:48:16 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:48:16 user nova-compute[74839]:     </disk>
Nov 18 15:48:16 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:48:16 user nova-compute[74839]:       <mac address="fa:16:3e:48:38:53"/>
Nov 18 15:48:16 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:16 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:48:16 user nova-compute[74839]:       <target dev="tapac0ae888-bb"/>
Nov 18 15:48:16 user nova-compute[74839]:     </interface>
Nov 18 15:48:16 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:48:16 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/console.log" append="off"/>
Nov 18 15:48:16 user nova-compute[74839]:     </serial>
Nov 18 15:48:16 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:48:16 user nova-compute[74839]:     <video>
Nov 18 15:48:16 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:16 user nova-compute[74839]:     </video>
Nov 18 15:48:16 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:48:16 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:48:16 user nova-compute[74839]:     </rng>
Nov 18 15:48:16 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:48:16 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:48:16 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:48:16 user nova-compute[74839]:     </memballoon>
Nov 18 15:48:16 user nova-compute[74839]:   </devices>
Nov 18 15:48:16 user nova-compute[74839]: </domain>
Nov 18 15:48:16 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-418205984',display_name='tempest-ServersNegativeTestJSON-server-418205984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-418205984',id=32,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-4vkdeu28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:15Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=cd8c15a1-13ba-43e8-a323-f59795539bd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG os_vif [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f0b5aeb-a3dd-5045-a7a8-2a8f00012c9f', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac0ae888-bb, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac0ae888-bb, col_values=(('qos', UUID('d030a56c-a8f1-4a5b-b200-71552b1cecc2')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac0ae888-bb, col_values=(('external_ids', {'iface-id': 'ac0ae888-bba5-4903-ad16-b13fb8f1afd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:38:53', 'vm-uuid': 'cd8c15a1-13ba-43e8-a323-f59795539bd3'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:16 user nova-compute[74839]: INFO os_vif [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb')
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] No VIF found with MAC fa:16:3e:48:38:53, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Updated VIF entry in instance network info cache for port ac0ae888-bba5-4903-ad16-b13fb8f1afd8. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG nova.network.neutron [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Updating instance_info_cache with network_info: [{"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d2293649-748e-405e-86fe-23983d1cd2f3 req-c7ca3f2e-c68a-4b48-a87a-2693f545c0df service nova] Releasing lock "refresh_cache-cd8c15a1-13ba-43e8-a323-f59795539bd3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG nova.compute.manager [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] No waiting events found dispatching network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:17 user nova-compute[74839]: WARNING nova.compute.manager [req-dc2dff4a-176c-4052-b6ce-282bb1e39b9c req-421c5684-e5c6-4ca2-ac66-4b5296358d50 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received unexpected event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 for instance with vm_state building and task_state spawning.
Nov 18 15:48:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:48:19 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Instance spawned successfully.
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] No waiting events found dispatching network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:19 user nova-compute[74839]: WARNING nova.compute.manager [req-3d646d14-a142-4a3b-a8e1-216a1edf5487 req-785b8004-2e32-495a-ab79-1282218c5db2 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received unexpected event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 for instance with vm_state building and task_state spawning.
Nov 18 15:48:19 user nova-compute[74839]: INFO nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:48:19 user nova-compute[74839]: INFO nova.compute.manager [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Took 5.90 seconds to build instance.
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0c1e9a1b-25a5-4262-b4dc-9ffa9d194b9b tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.012s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.213s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:19 user nova-compute[74839]: INFO nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:48:20 user nova-compute[74839]: INFO nova.compute.claims [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Claim successful on node user
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:48:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.policy [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5789c3f8f97b4d58871c77cdd19b969a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '572badc0c30b4e3ba5b41b49cb2f8ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:48:20 user nova-compute[74839]: INFO nova.virt.block_device [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Booting with volume c387a368-a8ff-409b-9731-ab29d3d6861e at /dev/vda
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.utils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[75546c77-4ef1-4d6f-9b65-721da3a96d8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f694ba-2d4f-4a80-acc0-da5e80175f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c7381-eaaf-4d39-ab27-bb883deed127]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eeeec7-6231-4450-989a-dfc7381f3c3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:48:20 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:48:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0096f417-7522-401d-8c02-88cdf4b96e98]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG os_brick.utils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:20 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating existing volume attachment record: e5ac1134-b303-467e-94de-c87da5aac1e1 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:48:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:21 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Successfully created port: 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Successfully updated port: 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-changed-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Refreshing instance network info cache due to event network-changed-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance network_info: |[{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Refreshing network info cache for port 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updated VIF entry in instance network info cache for port 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG nova.network.neutron [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9acfd71a-00ae-45df-8acc-040345460499 req-26a1fbcd-0145-4116-a0ad-2258326b7b77 service nova] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:48:26 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Creating image(s)
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Ensure instance console log exists: /opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start _get_guest_xml network_info=[{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e5ac1134-b303-467e-94de-c87da5aac1e1', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31053684-0b7e-476a-ad00-75855f339d6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c387a368-a8ff-409b-9731-ab29d3d6861e', 'serial': 'c387a368-a8ff-409b-9731-ab29d3d6861e'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:48:26 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:26 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:26 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:26 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:26 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92257a97-580b-4c9e-b8eb-b09be4c118cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:48:26 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91dd577-4897-48cb-b518-4d72d7c19cdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e] added
Nov 18 15:48:26 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fa858d-60db-4846-b303-1e75eac1ebec]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ffe9ff-ff18-4722-a3f2-10e1035230ed]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvTxnOdN {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvTxnOdN" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0eb091-6af3-4d7c-8cda-d067e4ceb58b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvTxnOdN'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[468245d8-2c9a-4e8d-a512-b070a24f966d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebca0ab7-8440-4343-8f33-c2e25952d9f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:48:27 user nova-compute[74839]: INFO nova.compute.claims [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Claim successful on node user
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[17719e5f-5af4-44b3-b309-77071c9f9f2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]
Nov 18 15:48:27 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.
Nov 18 15:48:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db74bf6-9afa-4a73-9695-fc9118919445]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab241809-4288-45fa-a128-5958f70b438a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:27 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:27 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d1602-1316-4b6d-bcf6-fdf0daa72ffb]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:48:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.policy [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75cef6e9b30942779dd9d0fc689c3947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b08331710a14c4d85ccca3fd806055b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:48:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Creating image(s)
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:27 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.207s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26163626239333239', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163626239333239', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Successfully created port: 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk 1073741824" returned: 0 in 0.060s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'pci_devices' on Instance uuid 31053684-0b7e-476a-ad00-75855f339d6e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:48:28 user nova-compute[74839]:   <uuid>31053684-0b7e-476a-ad00-75855f339d6e</uuid>
Nov 18 15:48:28 user nova-compute[74839]:   <name>instance-00000021</name>
Nov 18 15:48:28 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:48:28 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:48:28 user nova-compute[74839]:   <metadata>
Nov 18 15:48:28 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:48:28 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:48:28 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherA-server-207187813</nova:name>
Nov 18 15:48:28 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:48:26</nova:creationTime>
Nov 18 15:48:28 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:48:28 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:48:28 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:48:28 user nova-compute[74839]:       <nova:owner>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:user uuid="5789c3f8f97b4d58871c77cdd19b969a">tempest-ServerActionsTestOtherA-89343349-project-member</nova:user>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:project uuid="572badc0c30b4e3ba5b41b49cb2f8ed6">tempest-ServerActionsTestOtherA-89343349</nova:project>
Nov 18 15:48:28 user nova-compute[74839]:       </nova:owner>
Nov 18 15:48:28 user nova-compute[74839]:       <nova:ports>
Nov 18 15:48:28 user nova-compute[74839]:         <nova:port uuid="4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4">
Nov 18 15:48:28 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:48:28 user nova-compute[74839]:         </nova:port>
Nov 18 15:48:28 user nova-compute[74839]:       </nova:ports>
Nov 18 15:48:28 user nova-compute[74839]:     </nova:instance>
Nov 18 15:48:28 user nova-compute[74839]:   </metadata>
Nov 18 15:48:28 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:48:28 user nova-compute[74839]:     <system>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="serial">31053684-0b7e-476a-ad00-75855f339d6e</entry>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="uuid">31053684-0b7e-476a-ad00-75855f339d6e</entry>
Nov 18 15:48:28 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:48:28 user nova-compute[74839]:     </system>
Nov 18 15:48:28 user nova-compute[74839]:   </sysinfo>
Nov 18 15:48:28 user nova-compute[74839]:   <os>
Nov 18 15:48:28 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:48:28 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:48:28 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:48:28 user nova-compute[74839]:   </os>
Nov 18 15:48:28 user nova-compute[74839]:   <features>
Nov 18 15:48:28 user nova-compute[74839]:     <acpi/>
Nov 18 15:48:28 user nova-compute[74839]:     <apic/>
Nov 18 15:48:28 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:48:28 user nova-compute[74839]:   </features>
Nov 18 15:48:28 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:48:28 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:48:28 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:48:28 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:48:28 user nova-compute[74839]:   </clock>
Nov 18 15:48:28 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:48:28 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:48:28 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:48:28 user nova-compute[74839]:   </cpu>
Nov 18 15:48:28 user nova-compute[74839]:   <devices>
Nov 18 15:48:28 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:48:28 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:48:28 user nova-compute[74839]:       <source dev="/dev/sdd"/>
Nov 18 15:48:28 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:48:28 user nova-compute[74839]:       <serial>c387a368-a8ff-409b-9731-ab29d3d6861e</serial>
Nov 18 15:48:28 user nova-compute[74839]:     </disk>
Nov 18 15:48:28 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:48:28 user nova-compute[74839]:       <mac address="fa:16:3e:5e:1a:ab"/>
Nov 18 15:48:28 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:28 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:48:28 user nova-compute[74839]:       <target dev="tap4d85a813-fe"/>
Nov 18 15:48:28 user nova-compute[74839]:     </interface>
Nov 18 15:48:28 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:48:28 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e/console.log" append="off"/>
Nov 18 15:48:28 user nova-compute[74839]:     </serial>
Nov 18 15:48:28 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:48:28 user nova-compute[74839]:     <video>
Nov 18 15:48:28 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:28 user nova-compute[74839]:     </video>
Nov 18 15:48:28 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:48:28 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:48:28 user nova-compute[74839]:     </rng>
Nov 18 15:48:28 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:48:28 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:48:28 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:48:28 user nova-compute[74839]:     </memballoon>
Nov 18 15:48:28 user nova-compute[74839]:   </devices>
Nov 18 15:48:28 user nova-compute[74839]: </domain>
Nov 18 15:48:28 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG os_vif [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a4ee3b0-f76c-5170-b70b-60d4971a31e2', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d85a813-fe, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d85a813-fe, col_values=(('qos', UUID('b410c90f-cf1f-48d9-a8ba-f1d072245139')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d85a813-fe, col_values=(('external_ids', {'iface-id': '4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:1a:ab', 'vm-uuid': '31053684-0b7e-476a-ad00-75855f339d6e'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:28 user nova-compute[74839]: INFO os_vif [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe')
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:5e:1a:ab, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Cannot resize image /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Ensure instance console log exists: /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Successfully updated port: 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-changed-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing instance network info cache due to event network-changed-25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance network_info: |[{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start _get_guest_xml network_info=[{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:48:29 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:29 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1808538275',display_name='tempest-ServerRescueNegativeTestJSON-server-1808538275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1808538275',id=34,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICyu6/r9l+ppTsIuzWariAwtkTOhPgx/DWIN5iRu38XE5mcH4Hq1n6kgGxZ1ud7VZZ5CDWPGZ5IwOgRTG6UdvR5TRHTZDbSpt6g+pXLcuVyTNrFZJXBikL96eCInmLanA==',key_name='tempest-keypair-896753568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-69309dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=48b20f53-d048-4da5-8e93-9b22a4b20fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:48:29 user nova-compute[74839]:   <uuid>48b20f53-d048-4da5-8e93-9b22a4b20fbd</uuid>
Nov 18 15:48:29 user nova-compute[74839]:   <name>instance-00000022</name>
Nov 18 15:48:29 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:48:29 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:48:29 user nova-compute[74839]:   <metadata>
Nov 18 15:48:29 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:48:29 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1808538275</nova:name>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:48:29</nova:creationTime>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:48:29 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:48:29 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:owner>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:48:29 user nova-compute[74839]:       </nova:owner>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:48:29 user nova-compute[74839]:       <nova:ports>
Nov 18 15:48:29 user nova-compute[74839]:         <nova:port uuid="25445020-24b6-4503-87c6-a9e6749d687d">
Nov 18 15:48:29 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:48:29 user nova-compute[74839]:         </nova:port>
Nov 18 15:48:29 user nova-compute[74839]:       </nova:ports>
Nov 18 15:48:29 user nova-compute[74839]:     </nova:instance>
Nov 18 15:48:29 user nova-compute[74839]:   </metadata>
Nov 18 15:48:29 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:48:29 user nova-compute[74839]:     <system>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="serial">48b20f53-d048-4da5-8e93-9b22a4b20fbd</entry>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="uuid">48b20f53-d048-4da5-8e93-9b22a4b20fbd</entry>
Nov 18 15:48:29 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:48:29 user nova-compute[74839]:     </system>
Nov 18 15:48:29 user nova-compute[74839]:   </sysinfo>
Nov 18 15:48:29 user nova-compute[74839]:   <os>
Nov 18 15:48:29 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:48:29 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:48:29 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:48:29 user nova-compute[74839]:   </os>
Nov 18 15:48:29 user nova-compute[74839]:   <features>
Nov 18 15:48:29 user nova-compute[74839]:     <acpi/>
Nov 18 15:48:29 user nova-compute[74839]:     <apic/>
Nov 18 15:48:29 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:48:29 user nova-compute[74839]:   </features>
Nov 18 15:48:29 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:48:29 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:48:29 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:48:29 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:48:29 user nova-compute[74839]:   </clock>
Nov 18 15:48:29 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:48:29 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:48:29 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:48:29 user nova-compute[74839]:   </cpu>
Nov 18 15:48:29 user nova-compute[74839]:   <devices>
Nov 18 15:48:29 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:48:29 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:48:29 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk"/>
Nov 18 15:48:29 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:48:29 user nova-compute[74839]:     </disk>
Nov 18 15:48:29 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:48:29 user nova-compute[74839]:       <mac address="fa:16:3e:31:2b:cb"/>
Nov 18 15:48:29 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:29 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:48:29 user nova-compute[74839]:       <target dev="tap25445020-24"/>
Nov 18 15:48:29 user nova-compute[74839]:     </interface>
Nov 18 15:48:29 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:48:29 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/console.log" append="off"/>
Nov 18 15:48:29 user nova-compute[74839]:     </serial>
Nov 18 15:48:29 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:48:29 user nova-compute[74839]:     <video>
Nov 18 15:48:29 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:48:29 user nova-compute[74839]:     </video>
Nov 18 15:48:29 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:48:29 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:48:29 user nova-compute[74839]:     </rng>
Nov 18 15:48:29 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:48:29 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:48:29 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:48:29 user nova-compute[74839]:     </memballoon>
Nov 18 15:48:29 user nova-compute[74839]:   </devices>
Nov 18 15:48:29 user nova-compute[74839]: </domain>
Nov 18 15:48:29 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1808538275',display_name='tempest-ServerRescueNegativeTestJSON-server-1808538275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1808538275',id=34,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICyu6/r9l+ppTsIuzWariAwtkTOhPgx/DWIN5iRu38XE5mcH4Hq1n6kgGxZ1ud7VZZ5CDWPGZ5IwOgRTG6UdvR5TRHTZDbSpt6g+pXLcuVyTNrFZJXBikL96eCInmLanA==',key_name='tempest-keypair-896753568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-69309dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=48b20f53-d048-4da5-8e93-9b22a4b20fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG os_vif [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53a1e5fe-7f30-57d8-949b-5405ce5f464d', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25445020-24, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25445020-24, col_values=(('qos', UUID('248f28ae-5eab-4946-8fd6-9f7bc6714ec4')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25445020-24, col_values=(('external_ids', {'iface-id': '25445020-24b6-4503-87c6-a9e6749d687d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:2b:cb', 'vm-uuid': '48b20f53-d048-4da5-8e93-9b22a4b20fbd'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: INFO os_vif [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24')
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:31:2b:cb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updated VIF entry in instance network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99eb787d-d1f5-4fec-9587-d0db601002ff req-cb9ee5a1-1893-4839-90a9-f117fc002930 service nova] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:30 user nova-compute[74839]: WARNING nova.compute.manager [req-2d48a892-0e55-4ff7-bfa8-33f3fc095e37 req-0d37bef6-a6bf-46e3-9a5f-91333f47c885 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state building and task_state spawning.
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:31 user nova-compute[74839]: WARNING nova.compute.manager [req-d64bae02-8184-417c-b50d-5738b08642bc req-bc3a1e5b-187f-481d-8d62-b92a22dbfc8e service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state building and task_state spawning.
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:32 user nova-compute[74839]: WARNING nova.compute.manager [req-6a84fbe1-756f-4038-8972-d2aeeb2f5abe req-dab67491-fc11-4e2b-8c8a-44fb60d01b40 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state building and task_state spawning.
Nov 18 15:48:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:48:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:48:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance spawned successfully.
Nov 18 15:48:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: INFO nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:48:33 user nova-compute[74839]: INFO nova.compute.manager [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Took 13.31 seconds to build instance.
Nov 18 15:48:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1b6dbfe0-e143-4b49-9bd2-2674eeff4d74 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.403s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:33 user nova-compute[74839]: WARNING nova.compute.manager [req-02b75ca2-1e69-400f-973e-22ce7eda5fae req-35336894-c786-431d-a53f-b636dbd5abac service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state building and task_state spawning.
Nov 18 15:48:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance spawned successfully.
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:48:33 user nova-compute[74839]: INFO nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 18 15:48:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:48:33 user nova-compute[74839]: INFO nova.compute.manager [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Took 6.69 seconds to build instance.
Nov 18 15:48:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-77d08c1c-2e4f-4682-b966-14178a23df87 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.792s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:35 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 262be841-6b58-4075-832e-0e67a155c4aa is timed out.
Nov 18 15:48:35 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully detached device vdb from instance 262be841-6b58-4075-832e-0e67a155c4aa from the live domain config.
Nov 18 15:48:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqvBLIFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5400a4cf-2606-4176-9154-3ee57cc25d3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:48:35 user nova-compute[74839]: No targets found.
Nov 18 15:48:35 user nova-compute[74839]: iSNS:
Nov 18 15:48:35 user nova-compute[74839]: No targets found.
Nov 18 15:48:35 user nova-compute[74839]: STATIC:
Nov 18 15:48:35 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:48:35 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:35 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:35 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:48:35 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:35 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:35 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7
Nov 18 15:48:35 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:35 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:35 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:48:35 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:35 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:35 user nova-compute[74839]: FIRMWARE:
Nov 18 15:48:35 user nova-compute[74839]: No targets found.
Nov 18 15:48:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:48:35 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:48:35 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7fc40-f4bd-4e79-a097-74ed523fb29f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc17cd8-1053-4a31-91a7-c75b3aff734e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 (non-flash)
Nov 18 15:48:35 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801a7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[177a19ef-21c8-4416-b36d-75ba21d67a01]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f74c62-bb5e-4939-b238-93ea0007b520]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d4d36-4533-4680-a07e-86d014b50657]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[279065b3-bda0-4940-b755-3cbf5dc7e129]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d6e1c9-6d7f-4db6-a37d-824ea228b72a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[026828ad-5c6e-4ef5-9816-e3a21fdecfb5]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260]
Nov 18 15:48:35 user nova-compute[74839]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7, portal: 172.16.0.220,3260] successful.
Nov 18 15:48:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b94d2dc6-5675-4f41-867b-803d96ed86e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1643e5b-523f-4ccc-81ba-53cc52b223ee]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== disconnect_volume: return (325ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:35 user nova-compute[74839]: INFO nova.compute.manager [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Terminating instance
Nov 18 15:48:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-unplugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] No waiting events found dispatching network-vif-unplugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-2f1f6026-a5d2-46fa-9a98-563366d45326 req-138b5733-6e80-4993-aa3f-9f6cd93220ec service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-unplugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-042e5969-71eb-4fff-90dc-91f885f00ab8 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.805s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Instance destroyed successfully.
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lazy-loading 'resources' on Instance uuid 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-546014982',display_name='tempest-TestServerVolumeAttachmentScenario-server-546014982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-546014982',id=28,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ0lJ1srp9V3uxk4LyjvlTpM2MosPN9ZBwQEtNoi1FwbWFhs0uLnjliIxR4XRCs4acT9/+XG8CZ8axFDlRIcY7MquJlYuuMLteiaN2FRLk0HnGBv2siH4YE1amRhyk/qw==',key_name='tempest-keypair-257006294',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79791998433644babc3a23a9bcc83b32',ramdisk_id='',reservation_id='r-za1hsiiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1596425973',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1596425973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa275451859e4d35a4c7f5fcd7f48bbd',uuid=6fe9d3d8-f17e-447d-9d7f-d215b45f4a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converting VIF {"id": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "address": "fa:16:3e:c5:f4:e7", "network": {"id": "491ca3fc-8e7d-4cf6-882f-df4e04168a9f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-542030424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79791998433644babc3a23a9bcc83b32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6d8b9e-38", "ovs_interfaceid": "5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG os_vif [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d6d8b9e-38, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66fd2b1d-817a-4dcc-bcc9-6203651cf699) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:36 user nova-compute[74839]: INFO os_vif [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f4:e7,bridge_name='br-int',has_traffic_filtering=True,id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3,network=Network(491ca3fc-8e7d-4cf6-882f-df4e04168a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6d8b9e-38')
Nov 18 15:48:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Deleting instance files /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53_del
Nov 18 15:48:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Deletion of /opt/stack/data/nova/instances/6fe9d3d8-f17e-447d-9d7f-d215b45f4a53_del complete
Nov 18 15:48:36 user nova-compute[74839]: INFO nova.compute.manager [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 18 15:48:36 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:48:36 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:48:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:37 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Took 0.78 seconds to deallocate network for instance.
Nov 18 15:48:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-d5701280-06f3-4fa2-b1e6-059987725071 req-1db190f8-0d12-4343-ab22-52215b444a1c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-deleted-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:37 user nova-compute[74839]: INFO nova.compute.manager [req-d5701280-06f3-4fa2-b1e6-059987725071 req-1db190f8-0d12-4343-ab22-52215b444a1c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Neutron deleted interface 5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3; detaching it from the instance and deleting it from the info cache
Nov 18 15:48:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-d5701280-06f3-4fa2-b1e6-059987725071 req-1db190f8-0d12-4343-ab22-52215b444a1c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-d5701280-06f3-4fa2-b1e6-059987725071 req-1db190f8-0d12-4343-ab22-52215b444a1c service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Detach interface failed, port_id=5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3, reason: Instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:48:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:38 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Deleted allocations for instance 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53
Nov 18 15:48:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7c28007c-8d17-4de1-b344-c5e5928119c1 tempest-TestServerVolumeAttachmentScenario-1596425973 tempest-TestServerVolumeAttachmentScenario-1596425973-project-member] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] Acquiring lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] Lock "6fe9d3d8-f17e-447d-9d7f-d215b45f4a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] No waiting events found dispatching network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:38 user nova-compute[74839]: WARNING nova.compute.manager [req-677fafb6-6a45-44e4-9446-e7b48d944528 req-3c233676-9de0-4b90-858e-80a39f8ac5f7 service nova] [instance: 6fe9d3d8-f17e-447d-9d7f-d215b45f4a53] Received unexpected event network-vif-plugged-5d6d8b9e-380f-4d80-9bd7-2bff16fe4af3 for instance with vm_state deleted and task_state None.
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:40 user nova-compute[74839]: INFO nova.compute.manager [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Terminating instance
Nov 18 15:48:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-0d061835-ae6e-403f-ad22-6b8746c2a5b5 req-cb0162c5-58da-4c12-9d43-9ff13b481276 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-unplugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Instance destroyed successfully.
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 24fe45b3-613e-482d-988e-f72d865571b8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:43:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-347918971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-347918971',id=27,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-dl1f2mh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:46:55Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=24fe45b3-613e-482d-988e-f72d865571b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "address": "fa:16:3e:2a:3a:3a", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5492bcba-54", "ovs_interfaceid": "5492bcba-54cf-4e9c-9773-25d45b6a0a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_vif [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5492bcba-54, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a028e855-f597-4a02-8d12-65449090f16b) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:48:41 user nova-compute[74839]: INFO os_vif [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:3a,bridge_name='br-int',has_traffic_filtering=True,id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5492bcba-54')
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtoWBELD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:48:41 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c294694a-0179-4722-8979-104b89ba0626]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:48:41 user nova-compute[74839]: No targets found.
Nov 18 15:48:41 user nova-compute[74839]: iSNS:
Nov 18 15:48:41 user nova-compute[74839]: No targets found.
Nov 18 15:48:41 user nova-compute[74839]: STATIC:
Nov 18 15:48:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:48:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a
Nov 18 15:48:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:41 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:48:41 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:48:41 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:48:41 user nova-compute[74839]: FIRMWARE:
Nov 18 15:48:41 user nova-compute[74839]: No targets found.
Nov 18 15:48:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:48:41 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:48:41 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62d1f7-a73c-4687-8df9-0ccb14106412]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3502793-131b-4101-92e1-cea735e4bcc2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:41 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:41 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:48:41 user nova-compute[74839]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a (non-flash)
Nov 18 15:48:41 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:48:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd498130e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a'): ({'sdf'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Removing single pathed devices sdf {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72d2047-a293-4aa7-9e2a-867088ec44b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc933f-2194-43ae-bcdb-80208109bcc4]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flushing IO for device /dev/sdf {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf05081-b4b1-4858-9bd7-bc6ea993673f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16841a75-ff0f-45c6-bd45-24ac94481b87]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] SCSI volumes sdf have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4950f364-b7b267855bac34b9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4950f364', '/dev/disk/by-id/scsi-26237623236373835') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef0ed1c-dda8-43c5-a82f-122f4e321ac9]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db07b6-930b-4de8-b807-12b4a6d46cc3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2365f19c-41d1-4e9b-a21d-ff6418177679]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260]
Nov 18 15:48:41 user nova-compute[74839]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a, portal: 172.16.0.220,3260] successful.
Nov 18 15:48:41 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee3d83f7-9f93-41a4-9a8d-323ae4c0692a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb70eb-d8ef-45fa-9ece-acecf8c061e1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== disconnect_volume: return (311ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Deleting instance files /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8_del
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Deletion of /opt/stack/data/nova/instances/24fe45b3-613e-482d-988e-f72d865571b8_del complete
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.compute.manager [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 18 15:48:41 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Took 0.44 seconds to deallocate network for instance.
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-3948f06b-10f3-48c6-87dd-31e509275eb0 req-7a26a650-5060-4e24-9316-ef4b31f94fc3 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-deleted-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:41 user nova-compute[74839]: INFO nova.compute.manager [req-3948f06b-10f3-48c6-87dd-31e509275eb0 req-7a26a650-5060-4e24-9316-ef4b31f94fc3 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Neutron deleted interface 5492bcba-54cf-4e9c-9773-25d45b6a0a1a; detaching it from the instance and deleting it from the info cache
Nov 18 15:48:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-3948f06b-10f3-48c6-87dd-31e509275eb0 req-7a26a650-5060-4e24-9316-ef4b31f94fc3 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-3948f06b-10f3-48c6-87dd-31e509275eb0 req-7a26a650-5060-4e24-9316-ef4b31f94fc3 service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Detach interface failed, port_id=5492bcba-54cf-4e9c-9773-25d45b6a0a1a, reason: Instance 24fe45b3-613e-482d-988e-f72d865571b8 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] Acquiring lock "24fe45b3-613e-482d-988e-f72d865571b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] Lock "24fe45b3-613e-482d-988e-f72d865571b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] No waiting events found dispatching network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:48:42 user nova-compute[74839]: WARNING nova.compute.manager [req-374df230-8fa1-4897-9d9a-2addb9e304b9 req-0a345820-9026-4f52-9fab-5c9298e0a32e service nova] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Received unexpected event network-vif-plugged-5492bcba-54cf-4e9c-9773-25d45b6a0a1a for instance with vm_state active and task_state deleting.
Nov 18 15:48:43 user nova-compute[74839]: INFO nova.compute.manager [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 24fe45b3-613e-482d-988e-f72d865571b8] Took 1.04 seconds to detach 1 volumes for instance.
Nov 18 15:48:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:43 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:43 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:43 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Deleted allocations for instance 24fe45b3-613e-482d-988e-f72d865571b8
Nov 18 15:48:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2c567f66-9394-4962-89c7-16b0d31b9c11 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "24fe45b3-613e-482d-988e-f72d865571b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.548s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:48:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:48:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:48:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:48:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.07314682006836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance cd8c15a1-13ba-43e8-a323-f59795539bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:48:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:48:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:49:08 user nova-compute[74839]: INFO nova.compute.manager [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] instance snapshotting
Nov 18 15:49:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Beginning live snapshot process
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4.delta 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4.delta 1073741824" returned: 0 in 0.049s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 15:49:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:49:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:49:10 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 15:49:10 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:49:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4.delta /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4.delta /opt/stack/data/nova/instances/snapshots/tmp90917qk4/227196eca30c42e6a36501b908b2bfa4" returned: 0 in 0.471s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:10 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Snapshot extracted, beginning image upload
Nov 18 15:49:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Snapshot image upload complete
Nov 18 15:49:13 user nova-compute[74839]: INFO nova.compute.manager [None req-456d932b-0b97-4be8-ad4f-e134ba5ce2c0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Took 5.17 seconds to snapshot the instance on the hypervisor.
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:49:16 user nova-compute[74839]: INFO nova.compute.claims [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Claim successful on node user
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:49:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.policy [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a69cbda04c24c82b9d219c41bc524b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56fb5852e010490a872cd924843da9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:49:16 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Creating image(s)
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "/opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "/opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "/opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "8579e07af6d7c8651c638f62f029073b1cec0de5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "8579e07af6d7c8651c638f62f029073b1cec0de5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Successfully created port: 38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG nova.virt.images [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] 88272694-1f97-459f-bef2-e1f31fd9e4c2 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.part /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.part /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.converted" returned: 0 in 0.278s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "8579e07af6d7c8651c638f62f029073b1cec0de5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.788s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "8579e07af6d7c8651c638f62f029073b1cec0de5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "8579e07af6d7c8651c638f62f029073b1cec0de5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Successfully updated port: 38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquired lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:49:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing instance network info cache due to event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] Acquiring lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5,backing_fmt=raw /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5,backing_fmt=raw /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk 1073741824" returned: 0 in 0.058s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "8579e07af6d7c8651c638f62f029073b1cec0de5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Ensure instance console log exists: /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating instance_info_cache with network_info: [{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Releasing lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Instance network_info: |[{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] Acquired lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.neutron [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Start _get_guest_xml network_info=[{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='23c972e148a7caa8f822d29b82fa212b',container_format='bare',created_at=2023-11-18T15:49:08Z,direct_url=<?>,disk_format='qcow2',id=88272694-1f97-459f-bef2-e1f31fd9e4c2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-309631420',owner='56fb5852e010490a872cd924843da9b7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-18T15:49:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '88272694-1f97-459f-bef2-e1f31fd9e4c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:49:19 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:49:19 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='23c972e148a7caa8f822d29b82fa212b',container_format='bare',created_at=2023-11-18T15:49:08Z,direct_url=<?>,disk_format='qcow2',id=88272694-1f97-459f-bef2-e1f31fd9e4c2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-309631420',owner='56fb5852e010490a872cd924843da9b7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-18T15:49:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2045186579',display_name='tempest-TestStampPattern-server-2045186579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2045186579',id=35,image_ref='88272694-1f97-459f-bef2-e1f31fd9e4c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-vcx06x8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='262be841-6b58-4075-832e-0e67a155c4aa',image_min_disk='1',image_min_ram='0',image_owner_id='56fb5852e010490a872cd924843da9b7',image_owner_project_name='tempest-TestStampPattern-1229984930',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1229984930-project-member',image_user_id='3a69cbda04c24c82b9d219c41bc524b4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:49:17Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=c075fc5d-3e79-44bf-a5a1-ff4bf488ca27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'pci_devices' on Instance uuid c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:49:19 user nova-compute[74839]:   <uuid>c075fc5d-3e79-44bf-a5a1-ff4bf488ca27</uuid>
Nov 18 15:49:19 user nova-compute[74839]:   <name>instance-00000023</name>
Nov 18 15:49:19 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:49:19 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:49:19 user nova-compute[74839]:   <metadata>
Nov 18 15:49:19 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:49:19 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:name>tempest-TestStampPattern-server-2045186579</nova:name>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:49:19</nova:creationTime>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:49:19 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:49:19 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:owner>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:user uuid="3a69cbda04c24c82b9d219c41bc524b4">tempest-TestStampPattern-1229984930-project-member</nova:user>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:project uuid="56fb5852e010490a872cd924843da9b7">tempest-TestStampPattern-1229984930</nova:project>
Nov 18 15:49:19 user nova-compute[74839]:       </nova:owner>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:root type="image" uuid="88272694-1f97-459f-bef2-e1f31fd9e4c2"/>
Nov 18 15:49:19 user nova-compute[74839]:       <nova:ports>
Nov 18 15:49:19 user nova-compute[74839]:         <nova:port uuid="38a62d3f-69a3-4c7b-a051-5d84bb82923b">
Nov 18 15:49:19 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 15:49:19 user nova-compute[74839]:         </nova:port>
Nov 18 15:49:19 user nova-compute[74839]:       </nova:ports>
Nov 18 15:49:19 user nova-compute[74839]:     </nova:instance>
Nov 18 15:49:19 user nova-compute[74839]:   </metadata>
Nov 18 15:49:19 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:49:19 user nova-compute[74839]:     <system>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="serial">c075fc5d-3e79-44bf-a5a1-ff4bf488ca27</entry>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="uuid">c075fc5d-3e79-44bf-a5a1-ff4bf488ca27</entry>
Nov 18 15:49:19 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:49:19 user nova-compute[74839]:     </system>
Nov 18 15:49:19 user nova-compute[74839]:   </sysinfo>
Nov 18 15:49:19 user nova-compute[74839]:   <os>
Nov 18 15:49:19 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:49:19 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:49:19 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:49:19 user nova-compute[74839]:   </os>
Nov 18 15:49:19 user nova-compute[74839]:   <features>
Nov 18 15:49:19 user nova-compute[74839]:     <acpi/>
Nov 18 15:49:19 user nova-compute[74839]:     <apic/>
Nov 18 15:49:19 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:49:19 user nova-compute[74839]:   </features>
Nov 18 15:49:19 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:49:19 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:49:19 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:49:19 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:49:19 user nova-compute[74839]:   </clock>
Nov 18 15:49:19 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:49:19 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:49:19 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:49:19 user nova-compute[74839]:   </cpu>
Nov 18 15:49:19 user nova-compute[74839]:   <devices>
Nov 18 15:49:19 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:49:19 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:49:19 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk"/>
Nov 18 15:49:19 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:49:19 user nova-compute[74839]:     </disk>
Nov 18 15:49:19 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:49:19 user nova-compute[74839]:       <mac address="fa:16:3e:cf:e7:0d"/>
Nov 18 15:49:19 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:49:19 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:49:19 user nova-compute[74839]:       <target dev="tap38a62d3f-69"/>
Nov 18 15:49:19 user nova-compute[74839]:     </interface>
Nov 18 15:49:19 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:49:19 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/console.log" append="off"/>
Nov 18 15:49:19 user nova-compute[74839]:     </serial>
Nov 18 15:49:19 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:49:19 user nova-compute[74839]:     <video>
Nov 18 15:49:19 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:49:19 user nova-compute[74839]:     </video>
Nov 18 15:49:19 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:49:19 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:49:19 user nova-compute[74839]:     </rng>
Nov 18 15:49:19 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:49:19 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:49:19 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:49:19 user nova-compute[74839]:     </memballoon>
Nov 18 15:49:19 user nova-compute[74839]:   </devices>
Nov 18 15:49:19 user nova-compute[74839]: </domain>
Nov 18 15:49:19 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2045186579',display_name='tempest-TestStampPattern-server-2045186579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2045186579',id=35,image_ref='88272694-1f97-459f-bef2-e1f31fd9e4c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-vcx06x8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='262be841-6b58-4075-832e-0e67a155c4aa',image_min_disk='1',image_min_ram='0',image_owner_id='56fb5852e010490a872cd924843da9b7',image_owner_project_name='tempest-TestStampPattern-1229984930',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1229984930-project-member',image_user_id='3a69cbda04c24c82b9d219c41bc524b4',network_allocated='True',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:49:17Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=c075fc5d-3e79-44bf-a5a1-ff4bf488ca27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG os_vif [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14d6b272-3701-5164-b00d-dbe2fa859557', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a62d3f-69, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a62d3f-69, col_values=(('qos', UUID('a55791fa-2574-4589-a24e-9d8d18577120')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a62d3f-69, col_values=(('external_ids', {'iface-id': '38a62d3f-69a3-4c7b-a051-5d84bb82923b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:e7:0d', 'vm-uuid': 'c075fc5d-3e79-44bf-a5a1-ff4bf488ca27'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:19 user nova-compute[74839]: INFO os_vif [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69')
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No VIF found with MAC fa:16:3e:cf:e7:0d, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.neutron [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updated VIF entry in instance network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG nova.network.neutron [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating instance_info_cache with network_info: [{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:49:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-141d898a-6e4f-4143-93bb-c650db28ea62 req-268c0fcc-d548-4ee7-843b-74d04f328368 service nova] Releasing lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:49:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] No waiting events found dispatching network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:49:21 user nova-compute[74839]: WARNING nova.compute.manager [req-8e1b31d5-f296-420a-8ce6-1acaf971e815 req-6a640a9e-5d37-4da1-aa32-9a0f7e9529fd service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received unexpected event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b for instance with vm_state building and task_state spawning.
Nov 18 15:49:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] No waiting events found dispatching network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:49:23 user nova-compute[74839]: WARNING nova.compute.manager [req-44eeacc2-499a-4e30-89af-ac9b9942fba9 req-fbf30d22-2b13-4707-9b87-94ec4585d661 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received unexpected event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b for instance with vm_state building and task_state spawning.
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:49:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Instance spawned successfully.
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:49:23 user nova-compute[74839]: INFO nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 18 15:49:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:49:23 user nova-compute[74839]: INFO nova.compute.manager [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Took 7.25 seconds to build instance.
Nov 18 15:49:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b2727825-7b48-4fc2-b277-4bf8692789b0 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.343s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:31 user nova-compute[74839]: INFO nova.compute.manager [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Terminating instance
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-unplugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] No waiting events found dispatching network-vif-unplugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-6b3c7f18-10a7-4139-9234-edbb8d4e0ea1 req-5e40aa1f-b2fe-4ef7-b0be-cae99941d535 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-unplugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Instance destroyed successfully.
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 13975a6d-cb76-4a2d-9174-4427522bdbf8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-707643893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-707643893',id=24,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:40:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-385k8011',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:42:05Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=13975a6d-cb76-4a2d-9174-4427522bdbf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "address": "fa:16:3e:1f:ad:6f", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf379f0-ea", "ovs_interfaceid": "3cf379f0-ea69-4e0a-b140-585a9bedc218", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG os_vif [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cf379f0-ea, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8debd4f3-1239-4c4f-93a6-c46b2ef688b6) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:49:31 user nova-compute[74839]: INFO os_vif [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ad:6f,bridge_name='br-int',has_traffic_filtering=True,id=3cf379f0-ea69-4e0a-b140-585a9bedc218,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf379f0-ea')
Nov 18 15:49:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Deleting instance files /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8_del
Nov 18 15:49:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Deletion of /opt/stack/data/nova/instances/13975a6d-cb76-4a2d-9174-4427522bdbf8_del complete
Nov 18 15:49:31 user nova-compute[74839]: INFO nova.compute.manager [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 18 15:49:31 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:49:31 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:49:32 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Took 0.44 seconds to deallocate network for instance.
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-968e3a5a-7c68-49a2-9cc6-5dea4f7351d1 req-e7cbaa62-bb07-41a9-9875-bce0454ac3cd service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-deleted-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:32 user nova-compute[74839]: INFO nova.compute.manager [req-968e3a5a-7c68-49a2-9cc6-5dea4f7351d1 req-e7cbaa62-bb07-41a9-9875-bce0454ac3cd service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Neutron deleted interface 3cf379f0-ea69-4e0a-b140-585a9bedc218; detaching it from the instance and deleting it from the info cache
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-968e3a5a-7c68-49a2-9cc6-5dea4f7351d1 req-e7cbaa62-bb07-41a9-9875-bce0454ac3cd service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-968e3a5a-7c68-49a2-9cc6-5dea4f7351d1 req-e7cbaa62-bb07-41a9-9875-bce0454ac3cd service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Detach interface failed, port_id=3cf379f0-ea69-4e0a-b140-585a9bedc218, reason: Instance 13975a6d-cb76-4a2d-9174-4427522bdbf8 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:49:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:32 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Deleted allocations for instance 13975a6d-cb76-4a2d-9174-4427522bdbf8
Nov 18 15:49:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2913fe27-296f-4ad0-b0bc-6f62fe66e807 tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:49:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] Acquiring lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] Lock "13975a6d-cb76-4a2d-9174-4427522bdbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] No waiting events found dispatching network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:49:33 user nova-compute[74839]: WARNING nova.compute.manager [req-d6ad5d90-e5cd-4c3a-9b09-17091d3d6b60 req-80e125f0-bfe8-47f3-9c5a-c42514c29924 service nova] [instance: 13975a6d-cb76-4a2d-9174-4427522bdbf8] Received unexpected event network-vif-plugged-3cf379f0-ea69-4e0a-b140-585a9bedc218 for instance with vm_state deleted and task_state None.
Nov 18 15:49:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:49:50 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [{"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:49:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7572MB free_disk=25.040008544921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance cd8c15a1-13ba-43e8-a323-f59795539bd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:49:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:49:56 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:49:56 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:49:56 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:49:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:49:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:49:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:49:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:04 user nova-compute[74839]: INFO nova.compute.manager [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Terminating instance
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-unplugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] No waiting events found dispatching network-vif-unplugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-07110fa0-d1b7-4bae-b8a6-8259100d15f2 req-f017e202-0bd8-4de6-835c-63e5e2279636 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-unplugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Instance destroyed successfully.
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lazy-loading 'resources' on Instance uuid cd8c15a1-13ba-43e8-a323-f59795539bd3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-418205984',display_name='tempest-ServersNegativeTestJSON-server-418205984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-418205984',id=32,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-4vkdeu28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:48:20Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=cd8c15a1-13ba-43e8-a323-f59795539bd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "address": "fa:16:3e:48:38:53", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac0ae888-bb", "ovs_interfaceid": "ac0ae888-bba5-4903-ad16-b13fb8f1afd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG os_vif [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac0ae888-bb, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d030a56c-a8f1-4a5b-b200-71552b1cecc2) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:04 user nova-compute[74839]: INFO os_vif [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:38:53,bridge_name='br-int',has_traffic_filtering=True,id=ac0ae888-bba5-4903-ad16-b13fb8f1afd8,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac0ae888-bb')
Nov 18 15:50:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Deleting instance files /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3_del
Nov 18 15:50:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Deletion of /opt/stack/data/nova/instances/cd8c15a1-13ba-43e8-a323-f59795539bd3_del complete
Nov 18 15:50:04 user nova-compute[74839]: INFO nova.compute.manager [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 18 15:50:04 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:50:04 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:05 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Took 0.44 seconds to deallocate network for instance.
Nov 18 15:50:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-f9c7da15-220d-4f55-89fa-b5e4d6099c5a req-dcb510b7-06d8-48f3-95e1-5eefe75da718 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-deleted-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:50:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:05 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Deleted allocations for instance cd8c15a1-13ba-43e8-a323-f59795539bd3
Nov 18 15:50:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88166812-f8b3-4926-a950-eeef0ff889ca tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.714s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] Acquiring lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] Lock "cd8c15a1-13ba-43e8-a323-f59795539bd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:06 user nova-compute[74839]: DEBUG nova.compute.manager [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] No waiting events found dispatching network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:06 user nova-compute[74839]: WARNING nova.compute.manager [req-71097f4a-a38d-4484-bae1-ba5cfdc467c8 req-3992353e-28c3-41cc-8769-6fcd50d0ea97 service nova] [instance: cd8c15a1-13ba-43e8-a323-f59795539bd3] Received unexpected event network-vif-plugged-ac0ae888-bba5-4903-ad16-b13fb8f1afd8 for instance with vm_state deleted and task_state None.
Nov 18 15:50:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing instance network info cache due to event network-changed-c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Refreshing network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:50:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updated VIF entry in instance network info cache for port c799ed01-94bb-47bd-85a4-36f181a215ba. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:50:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-08dfc748-2d23-43fb-b3bc-5244c75d9621 req-072ec0ec-1948-4c3d-ab72-4713d60edae6 service nova] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Stashing vm_state: active {{(pid=74839) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:50:12 user nova-compute[74839]: INFO nova.compute.claims [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Claim successful on node user
Nov 18 15:50:12 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating resource usage from migration 0a615fb1-27e2-499d-87e1-c5a960d87916
Nov 18 15:50:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-changed-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Refreshing instance network info cache due to event network-changed-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:12 user nova-compute[74839]: DEBUG nova.network.neutron [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Refreshing network info cache for port 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.555s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:13 user nova-compute[74839]: INFO nova.compute.manager [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Migrating
Nov 18 15:50:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updated VIF entry in instance network info cache for port 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8884a341-fb38-40f2-a453-5cc68d35c74b req-36eb77a4-7e0d-4cd1-a84d-7be65947c392 service nova] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.network.neutron [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.network.neutron [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Starting migrate_disk_and_power_off {{(pid=74839) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:14 user nova-compute[74839]: WARNING nova.compute.manager [req-9c5dfbcd-3387-4623-a988-5b65f65afded req-575dd817-bce7-466c-a859-ed2abd3e9d68 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state active and task_state resize_migrating.
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance destroyed successfully.
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d85a813-fe, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b410c90f-cf1f-48d9-a8ba-f1d072245139) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:14 user nova-compute[74839]: INFO os_vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe')
Nov 18 15:50:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceacfc2-9140-4ef4-a2e0-605c73bfd4a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:50:14 user nova-compute[74839]: No targets found.
Nov 18 15:50:14 user nova-compute[74839]: iSNS:
Nov 18 15:50:14 user nova-compute[74839]: No targets found.
Nov 18 15:50:14 user nova-compute[74839]: STATIC:
Nov 18 15:50:14 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:50:14 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:50:14 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:50:14 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:50:14 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:50:14 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:50:14 user nova-compute[74839]: FIRMWARE:
Nov 18 15:50:14 user nova-compute[74839]: No targets found.
Nov 18 15:50:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:50:14 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:50:14 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb5a7c-1e42-4a75-93b9-f1fd16a1a915]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1bdb4-b38e-447e-8ad2-e85f7aa7a91c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:50:14 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:50:14 user nova-compute[74839]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49829f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae0dc9b-a29d-476b-acfe-0bee960da527]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[87df10c3-5173-4260-ac50-3b4689a8cbd6]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aee489f-0a1a-411c-8b92-7359da4fe859]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00736ad-fac5-46cf-9de0-e53099deab4d]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e07215d7', '/dev/disk/by-id/scsi-1SCST_BIOe07215d7-acbb93291fde574f', '/dev/disk/by-id/scsi-26163626239333239') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed69cd-74be-447b-bea5-5686b7c0610a]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee5b12-e423-4b2b-8617-97bededce1f8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c88205-20a0-44c8-974c-25086e007060]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]
Nov 18 15:50:14 user nova-compute[74839]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.
Nov 18 15:50:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d749fd2-e26a-485b-affa-75f6a2d1fb4e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== disconnect_volume: return (327ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:50:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Port 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 binding to destination host user is already ACTIVE {{(pid=74839) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.compute.manager [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:16 user nova-compute[74839]: WARNING nova.compute.manager [req-86921522-e992-4ef6-ab86-a4531b577bd7 req-64172699-f7b7-4a68-a552-050d7b67739d service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state active and task_state resize_migrated.
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.utils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec826d9c-4b74-4be0-af11-5a6b0ba36dd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ffedcb-8fd6-4f31-8288-107641a357ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d720ffd1-a815-4676-b00c-ab86d72da636]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8494fc24-df18-4e65-bf42-4006a46dd52a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:50:16 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[584a5455-9d24-439c-9897-b21f11e8b965]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG os_brick.utils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:50:17 user nova-compute[74839]: INFO nova.compute.claims [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Claim successful on node user
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:50:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.policy [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baefb1ed20034faa83b9872267e74460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7daccded38c4ddf9815114b16e9e798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:50:17 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Creating image(s)
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "/opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "/opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "/opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk 1073741824" returned: 0 in 0.061s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-changed-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.compute.manager [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing instance network info cache due to event network-changed-25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.network.neutron [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.objects.instance [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'flavor' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Cannot resize image /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Ensure instance console log exists: /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:18 user nova-compute[74839]: INFO nova.compute.manager [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Attaching volume 1bb05510-c268-4bdb-b2fa-3b16c2e6603b to /dev/vdb
Nov 18 15:50:18 user nova-compute[74839]: DEBUG os_brick.utils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc38227-fa15-41b1-a36b-a6089b747d05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d44337e-bbbc-4103-9260-7246327548eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e382e-9cc8-4e49-b40a-0cdd5cb3fc8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afbd77e-2b77-4b9e-b987-80e3b112c996]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updated VIF entry in instance network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Successfully created port: f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1bdd3506-74c2-4b1c-a90f-3580ec190ba7 req-8eae5961-85cc-42bd-a4cf-b1bb97044e5d service nova] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:50:19 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64efd9-2480-4c1f-99ed-d8b44d2064da]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG os_brick.utils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating existing volume attachment record: e012a9c7-788f-4ad6-a0f6-797e8881dea9 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Successfully updated port: f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquired lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:50:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating instance_info_cache with network_info: [{"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Releasing lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Instance network_info: |[{"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Start _get_guest_xml network_info=[{"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:50:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-360640106',display_name='tempest-VolumesSnapshotTestJSON-instance-360640106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-360640106',id=36,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5/gGqg9pOYZ9979iWUq60Pd6lk0r1TNmmFiJhJcmJMwumvBwLBqJ9dErI+hvM8eQBrfcaryBnWZLLsN19Nlh/eBFAi9CbdjzJkzJPcmlvAWZloc4sAn99zyiGdITN4g==',key_name='tempest-keypair-1744632358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-hkoj1bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'pci_devices' on Instance uuid d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:50:20 user nova-compute[74839]:   <uuid>d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e</uuid>
Nov 18 15:50:20 user nova-compute[74839]:   <name>instance-00000024</name>
Nov 18 15:50:20 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:50:20 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:50:20 user nova-compute[74839]:   <metadata>
Nov 18 15:50:20 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:50:20 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-360640106</nova:name>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:50:20</nova:creationTime>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:50:20 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:50:20 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:owner>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:user uuid="baefb1ed20034faa83b9872267e74460">tempest-VolumesSnapshotTestJSON-1293713294-project-member</nova:user>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:project uuid="e7daccded38c4ddf9815114b16e9e798">tempest-VolumesSnapshotTestJSON-1293713294</nova:project>
Nov 18 15:50:20 user nova-compute[74839]:       </nova:owner>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:50:20 user nova-compute[74839]:       <nova:ports>
Nov 18 15:50:20 user nova-compute[74839]:         <nova:port uuid="f7afa2a4-1cd0-41e6-b390-98c5ba25cda2">
Nov 18 15:50:20 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 18 15:50:20 user nova-compute[74839]:         </nova:port>
Nov 18 15:50:20 user nova-compute[74839]:       </nova:ports>
Nov 18 15:50:20 user nova-compute[74839]:     </nova:instance>
Nov 18 15:50:20 user nova-compute[74839]:   </metadata>
Nov 18 15:50:20 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:50:20 user nova-compute[74839]:     <system>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="serial">d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e</entry>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="uuid">d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e</entry>
Nov 18 15:50:20 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:50:20 user nova-compute[74839]:     </system>
Nov 18 15:50:20 user nova-compute[74839]:   </sysinfo>
Nov 18 15:50:20 user nova-compute[74839]:   <os>
Nov 18 15:50:20 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:50:20 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:50:20 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:50:20 user nova-compute[74839]:   </os>
Nov 18 15:50:20 user nova-compute[74839]:   <features>
Nov 18 15:50:20 user nova-compute[74839]:     <acpi/>
Nov 18 15:50:20 user nova-compute[74839]:     <apic/>
Nov 18 15:50:20 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:50:20 user nova-compute[74839]:   </features>
Nov 18 15:50:20 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:50:20 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:50:20 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:50:20 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:50:20 user nova-compute[74839]:   </clock>
Nov 18 15:50:20 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:50:20 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:50:20 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:50:20 user nova-compute[74839]:   </cpu>
Nov 18 15:50:20 user nova-compute[74839]:   <devices>
Nov 18 15:50:20 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:50:20 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:50:20 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk"/>
Nov 18 15:50:20 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:50:20 user nova-compute[74839]:     </disk>
Nov 18 15:50:20 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:50:20 user nova-compute[74839]:       <mac address="fa:16:3e:8a:43:93"/>
Nov 18 15:50:20 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:20 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:50:20 user nova-compute[74839]:       <target dev="tapf7afa2a4-1c"/>
Nov 18 15:50:20 user nova-compute[74839]:     </interface>
Nov 18 15:50:20 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:50:20 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/console.log" append="off"/>
Nov 18 15:50:20 user nova-compute[74839]:     </serial>
Nov 18 15:50:20 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:50:20 user nova-compute[74839]:     <video>
Nov 18 15:50:20 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:20 user nova-compute[74839]:     </video>
Nov 18 15:50:20 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:50:20 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:50:20 user nova-compute[74839]:     </rng>
Nov 18 15:50:20 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:50:20 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:50:20 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:50:20 user nova-compute[74839]:     </memballoon>
Nov 18 15:50:20 user nova-compute[74839]:   </devices>
Nov 18 15:50:20 user nova-compute[74839]: </domain>
Nov 18 15:50:20 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-360640106',display_name='tempest-VolumesSnapshotTestJSON-instance-360640106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-360640106',id=36,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5/gGqg9pOYZ9979iWUq60Pd6lk0r1TNmmFiJhJcmJMwumvBwLBqJ9dErI+hvM8eQBrfcaryBnWZLLsN19Nlh/eBFAi9CbdjzJkzJPcmlvAWZloc4sAn99zyiGdITN4g==',key_name='tempest-keypair-1744632358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-hkoj1bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG os_vif [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2880e4de-5c2e-5238-98ee-5dafc9e3ae0e', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7afa2a4-1c, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7afa2a4-1c, col_values=(('qos', UUID('f47aeb8a-b583-40f5-bc5c-57dbe326080a')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7afa2a4-1c, col_values=(('external_ids', {'iface-id': 'f7afa2a4-1cd0-41e6-b390-98c5ba25cda2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:43:93', 'vm-uuid': 'd55c820c-6b1a-40f1-8c9d-275b1b7b8c9e'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: INFO os_vif [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c')
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No VIF found with MAC fa:16:3e:8a:43:93, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-changed-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Refreshing instance network info cache due to event network-changed-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] Acquiring lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] Acquired lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.neutron [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Refreshing network info cache for port f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.neutron [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updated VIF entry in instance network info cache for port f7afa2a4-1cd0-41e6-b390-98c5ba25cda2. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG nova.network.neutron [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating instance_info_cache with network_info: [{"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3d7b111d-a06b-44e7-9402-fd42f2926082 req-c3ef8faf-da3d-4cbc-9568-91d48edb23b3 service nova] Releasing lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:21 user nova-compute[74839]: INFO nova.compute.manager [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Terminating instance
Nov 18 15:50:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] No waiting events found dispatching network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:22 user nova-compute[74839]: WARNING nova.compute.manager [req-a1ec8270-46cf-4c9c-b1dd-0b506a6aebce req-1fd01e15-027e-48d1-a334-5f870c878392 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received unexpected event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 for instance with vm_state building and task_state spawning.
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-unplugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Acquiring lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] No waiting events found dispatching network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:22 user nova-compute[74839]: WARNING nova.compute.manager [req-3851a19e-fe30-4454-abd2-cda75213bbbf req-a80739cd-7845-4d7d-8c07-ded3f6479b27 service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received unexpected event network-vif-plugged-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 for instance with vm_state active and task_state deleting.
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Instance destroyed successfully.
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1591171237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1591171237',id=11,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-edk04wim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:38:21Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "address": "fa:16:3e:a1:fa:14", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc05a6d87-de", "ovs_interfaceid": "c05a6d87-de9e-4d8a-929c-024bdcdb85b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_vif [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc05a6d87-de, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84e59ffe-34f7-4ca9-bf5f-572aedd21890) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: INFO os_vif [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:fa:14,bridge_name='br-int',has_traffic_filtering=True,id=c05a6d87-de9e-4d8a-929c-024bdcdb85b9,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc05a6d87-de')
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QauMSdgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:22 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a52b26-8fd4-4c89-96fd-a9f4a5029466]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:50:22 user nova-compute[74839]: No targets found.
Nov 18 15:50:22 user nova-compute[74839]: iSNS:
Nov 18 15:50:22 user nova-compute[74839]: No targets found.
Nov 18 15:50:22 user nova-compute[74839]: STATIC:
Nov 18 15:50:22 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215
Nov 18 15:50:22 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:50:22 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:50:22 user nova-compute[74839]: FIRMWARE:
Nov 18 15:50:22 user nova-compute[74839]: No targets found.
Nov 18 15:50:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:50:22 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:50:22 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3c12b0-6dec-47ae-9c61-7b5703bb19bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa306f-4af3-4977-80ad-afa00d8c93f9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:50:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 (non-flash)
Nov 18 15:50:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c6d3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[454a690c-8cb8-49d7-9bc9-aa5d6bc362f2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54553431-7a01-421a-8ad8-00a126b96980]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0134f3-4376-4859-8fd3-22bf4119b272]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dcba9-7cfa-4b70-afda-b29bdf595ff7]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ed7c63-01d3-4e72-80c6-69dd37e1b3e6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c032f944-6c26-4c28-bc8e-da79c48699b2]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260]
Nov 18 15:50:22 user nova-compute[74839]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215, portal: 172.16.0.220,3260] successful.
Nov 18 15:50:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a8f7cc-e2f9-482a-9bf1-39aceceb4215 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905eed3-7050-410f-93f1-b63dfbb06974]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] <== disconnect_volume: return (346ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:50:22 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Deleting instance files /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8_del
Nov 18 15:50:22 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Deletion of /opt/stack/data/nova/instances/2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8_del complete
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Starting finish_migration {{(pid=74839) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:50:22 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Creating image(s)
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Ensure instance console log exists: /opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start _get_guest_xml network_info=[{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e1f0584d-35cc-4462-90bd-5c9e08c2947b', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '31053684-0b7e-476a-ad00-75855f339d6e', 'attached_at': '2023-11-18T15:50:23.000000', 'detached_at': '', 'volume_id': 'c387a368-a8ff-409b-9731-ab29d3d6861e', 'serial': 'c387a368-a8ff-409b-9731-ab29d3d6861e'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:50:22 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:22 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:50:22 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:23 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: INFO nova.compute.manager [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d328ccf3-8b2f-456f-a26d-49644fdc15cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:50:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617f88f-aa3b-429b-a331-df586e198ee1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e] added
Nov 18 15:50:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1944da81-c484-4135-91da-8a3892e6bf25]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a512140-9d0a-4daf-bc01-8ca3d7c50331]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvTxnOdN {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvTxnOdN" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0e9fb-cfb0-4290-8df3-d4284bd4e0fc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvTxnOdN'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c21b3-ceb4-45b6-a514-4e590fcc6283]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[296425c3-030d-4be0-9f9f-9491eec9628c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:50:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:50:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:50:23 user nova-compute[74839]: 
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9da533-308e-42cf-b6e7-9896fd0e8637]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]
Nov 18 15:50:23 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.
Nov 18 15:50:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[312179e2-baff-4a86-a888-cb945026e378]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a17281-1e3f-4dca-a6b2-c10b896ed3cd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2396715d-1008-4fb8-80d2-8a911cd980ce]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:50:23 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:23 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Took 0.44 seconds to deallocate network for instance.
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] No waiting events found dispatching network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:24 user nova-compute[74839]: WARNING nova.compute.manager [req-1402bdb7-1d05-4715-9c87-0f2dd8ec340e req-a05d4783-5480-457b-9825-8728b0b870c6 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received unexpected event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 for instance with vm_state building and task_state spawning.
Nov 18 15:50:24 user nova-compute[74839]: INFO nova.compute.manager [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26163626239333239', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163626239333239', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:50:24 user nova-compute[74839]:   <uuid>31053684-0b7e-476a-ad00-75855f339d6e</uuid>
Nov 18 15:50:24 user nova-compute[74839]:   <name>instance-00000021</name>
Nov 18 15:50:24 user nova-compute[74839]:   <memory>2097152</memory>
Nov 18 15:50:24 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:50:24 user nova-compute[74839]:   <metadata>
Nov 18 15:50:24 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:50:24 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:50:24 user nova-compute[74839]:       <nova:name>tempest-ServerActionsTestOtherA-server-207187813</nova:name>
Nov 18 15:50:24 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:50:22</nova:creationTime>
Nov 18 15:50:24 user nova-compute[74839]:       <nova:flavor name="m1.small">
Nov 18 15:50:24 user nova-compute[74839]:         <nova:memory>2048</nova:memory>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:disk>20</nova:disk>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:50:24 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:50:24 user nova-compute[74839]:       <nova:owner>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:user uuid="5789c3f8f97b4d58871c77cdd19b969a">tempest-ServerActionsTestOtherA-89343349-project-member</nova:user>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:project uuid="572badc0c30b4e3ba5b41b49cb2f8ed6">tempest-ServerActionsTestOtherA-89343349</nova:project>
Nov 18 15:50:24 user nova-compute[74839]:       </nova:owner>
Nov 18 15:50:24 user nova-compute[74839]:       <nova:ports>
Nov 18 15:50:24 user nova-compute[74839]:         <nova:port uuid="4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4">
Nov 18 15:50:24 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 18 15:50:24 user nova-compute[74839]:         </nova:port>
Nov 18 15:50:24 user nova-compute[74839]:       </nova:ports>
Nov 18 15:50:24 user nova-compute[74839]:     </nova:instance>
Nov 18 15:50:24 user nova-compute[74839]:   </metadata>
Nov 18 15:50:24 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:50:24 user nova-compute[74839]:     <system>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="serial">31053684-0b7e-476a-ad00-75855f339d6e</entry>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="uuid">31053684-0b7e-476a-ad00-75855f339d6e</entry>
Nov 18 15:50:24 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:50:24 user nova-compute[74839]:     </system>
Nov 18 15:50:24 user nova-compute[74839]:   </sysinfo>
Nov 18 15:50:24 user nova-compute[74839]:   <os>
Nov 18 15:50:24 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:50:24 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:50:24 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:50:24 user nova-compute[74839]:   </os>
Nov 18 15:50:24 user nova-compute[74839]:   <features>
Nov 18 15:50:24 user nova-compute[74839]:     <acpi/>
Nov 18 15:50:24 user nova-compute[74839]:     <apic/>
Nov 18 15:50:24 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:50:24 user nova-compute[74839]:   </features>
Nov 18 15:50:24 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:50:24 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:50:24 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:50:24 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:50:24 user nova-compute[74839]:   </clock>
Nov 18 15:50:24 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:50:24 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:50:24 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:50:24 user nova-compute[74839]:   </cpu>
Nov 18 15:50:24 user nova-compute[74839]:   <devices>
Nov 18 15:50:24 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:50:24 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:50:24 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:50:24 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:50:24 user nova-compute[74839]:       <serial>c387a368-a8ff-409b-9731-ab29d3d6861e</serial>
Nov 18 15:50:24 user nova-compute[74839]:     </disk>
Nov 18 15:50:24 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:50:24 user nova-compute[74839]:       <mac address="fa:16:3e:5e:1a:ab"/>
Nov 18 15:50:24 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:24 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:50:24 user nova-compute[74839]:       <target dev="tap4d85a813-fe"/>
Nov 18 15:50:24 user nova-compute[74839]:     </interface>
Nov 18 15:50:24 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:50:24 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e/console.log" append="off"/>
Nov 18 15:50:24 user nova-compute[74839]:     </serial>
Nov 18 15:50:24 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:50:24 user nova-compute[74839]:     <video>
Nov 18 15:50:24 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:24 user nova-compute[74839]:     </video>
Nov 18 15:50:24 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:50:24 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:50:24 user nova-compute[74839]:     </rng>
Nov 18 15:50:24 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:50:24 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:50:24 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:50:24 user nova-compute[74839]:     </memballoon>
Nov 18 15:50:24 user nova-compute[74839]:   </devices>
Nov 18 15:50:24 user nova-compute[74839]: </domain>
Nov 18 15:50:24 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-181801797-network", "vif_mac": "fa:16:3e:5e:1a:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG os_vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a4ee3b0-f76c-5170-b70b-60d4971a31e2', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d85a813-fe, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d85a813-fe, col_values=(('qos', UUID('966236e1-1c39-428f-a51a-a41be0290bb5')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d85a813-fe, col_values=(('external_ids', {'iface-id': '4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:1a:ab', 'vm-uuid': '31053684-0b7e-476a-ad00-75855f339d6e'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:24 user nova-compute[74839]: INFO os_vif [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe')
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] No VIF found with MAC fa:16:3e:5e:1a:ab, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:50:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Instance spawned successfully.
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-32889b66-61a7-40bc-890e-2d58988dfed8 req-d7313031-0aae-4e3d-8fdc-708dd787032c service nova] [instance: 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8] Received event network-vif-deleted-c05a6d87-de9e-4d8a-929c-024bdcdb85b9 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:24 user nova-compute[74839]: INFO nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:24 user nova-compute[74839]: INFO nova.compute.manager [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Took 7.75 seconds to build instance.
Nov 18 15:50:24 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Deleted allocations for instance 2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0990436a-b89b-4455-81c2-1ffb548208aa tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.868s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1020da7e-0cf9-401c-bfbf-0e1360aca4ea tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "2e98f2d3-68ec-4c9b-9cb4-2d1c27170ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONrmIpuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:50:25 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:25 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:50:25 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff7b239-2d45-473d-91f0-ded91fc28ab4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:50:25 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff87e13-e96c-4abc-be34-f80462242d1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b] added
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b1c7a-293a-4d11-9291-2d0825f9ef02]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c4c76-ac13-41cf-9104-ca6040b6d658]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONrmIpuh {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONrmIpuh" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fedd5c5-62f4-43cc-9372-bbddd8449430]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONrmIpuh'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[674aa7a7-7c4b-4f50-85a9-3ece4385d6a7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[404fc2b3-7eff-4b84-9c72-91d2c7bc1637]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ef3ce-5228-4990-88e8-64425e885b5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260]
Nov 18 15:50:25 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260] successful.
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[132546de-a9aa-42ee-9b04-bf87be20ff06]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[954342ce-be51-4b47-ace5-c48ccf5c0839]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:25 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:50:25 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:50:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[431beffa-ddcd-4563-a65c-dd4edb00c054]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONrmIpuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:26 user nova-compute[74839]: WARNING nova.compute.manager [req-e0248121-9251-4350-a7bf-991226753ac9 req-9018659a-48a4-4627-9be7-a45353117b50 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state active and task_state resize_finish.
Nov 18 15:50:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26661613530663430', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661613530663430', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'flavor' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:50:26 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:50:26 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:50:26 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:50:26 user nova-compute[74839]:   <serial>1bb05510-c268-4bdb-b2fa-3b16c2e6603b</serial>
Nov 18 15:50:26 user nova-compute[74839]: </disk>
Nov 18 15:50:26 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:31:2b:cb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:50:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-463d0c62-91a1-49ae-8eb1-414fda04b4e9 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.179s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:27 user nova-compute[74839]: INFO nova.compute.manager [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Rescuing
Nov 18 15:50:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:27 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:28 user nova-compute[74839]: WARNING nova.compute.manager [req-41cb1365-6d89-41ab-ac63-2c389911cf34 req-b8865ea1-513e-4c78-a1b4-40e1bac9bfc2 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state active and task_state resize_finish.
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.compute.manager [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:50:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance running successfully.
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Failed to set time: agent not configured {{(pid=74839) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-e2780691-f612-4ce4-93cd-6ba3ad2d4280 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] finish_migration finished successfully. {{(pid=74839) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.network.neutron [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:28 user nova-compute[74839]: WARNING nova.compute.manager [req-52e7b343-b452-4f88-808d-2672f14d43d3 req-28457805-6e19-47ab-a0b4-6130d9d0e2ec service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state active and task_state rescuing.
Nov 18 15:50:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance destroyed successfully.
Nov 18 15:50:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Attempting rescue
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 15:50:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Creating image(s)
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue" returned: 0 in 0.049s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'migration_context' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.base [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<48b20f53-d048-4da5-8e93-9b22a4b20fbd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start _get_guest_xml network_info=[{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:31:2b:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.base [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<48b20f53-d048-4da5-8e93-9b22a4b20fbd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'numa_topology' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.base [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<48b20f53-d048-4da5-8e93-9b22a4b20fbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:50:29 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:29 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.base [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<48b20f53-d048-4da5-8e93-9b22a4b20fbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1808538275',display_name='tempest-ServerRescueNegativeTestJSON-server-1808538275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1808538275',id=34,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICyu6/r9l+ppTsIuzWariAwtkTOhPgx/DWIN5iRu38XE5mcH4Hq1n6kgGxZ1ud7VZZ5CDWPGZ5IwOgRTG6UdvR5TRHTZDbSpt6g+pXLcuVyTNrFZJXBikL96eCInmLanA==',key_name='tempest-keypair-896753568',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-69309dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=48b20f53-d048-4da5-8e93-9b22a4b20fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:31:2b:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "vif_mac": "fa:16:3e:31:2b:cb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'pci_devices' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.objects.base [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Object Instance<48b20f53-d048-4da5-8e93-9b22a4b20fbd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:50:29 user nova-compute[74839]:   <uuid>48b20f53-d048-4da5-8e93-9b22a4b20fbd</uuid>
Nov 18 15:50:29 user nova-compute[74839]:   <name>instance-00000022</name>
Nov 18 15:50:29 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:50:29 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:50:29 user nova-compute[74839]:   <metadata>
Nov 18 15:50:29 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:50:29 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1808538275</nova:name>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:50:29</nova:creationTime>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:50:29 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:50:29 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:owner>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:user uuid="75cef6e9b30942779dd9d0fc689c3947">tempest-ServerRescueNegativeTestJSON-1006144467-project-member</nova:user>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:project uuid="5b08331710a14c4d85ccca3fd806055b">tempest-ServerRescueNegativeTestJSON-1006144467</nova:project>
Nov 18 15:50:29 user nova-compute[74839]:       </nova:owner>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:50:29 user nova-compute[74839]:       <nova:ports>
Nov 18 15:50:29 user nova-compute[74839]:         <nova:port uuid="25445020-24b6-4503-87c6-a9e6749d687d">
Nov 18 15:50:29 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 15:50:29 user nova-compute[74839]:         </nova:port>
Nov 18 15:50:29 user nova-compute[74839]:       </nova:ports>
Nov 18 15:50:29 user nova-compute[74839]:     </nova:instance>
Nov 18 15:50:29 user nova-compute[74839]:   </metadata>
Nov 18 15:50:29 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:50:29 user nova-compute[74839]:     <system>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="serial">48b20f53-d048-4da5-8e93-9b22a4b20fbd</entry>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="uuid">48b20f53-d048-4da5-8e93-9b22a4b20fbd</entry>
Nov 18 15:50:29 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:50:29 user nova-compute[74839]:     </system>
Nov 18 15:50:29 user nova-compute[74839]:   </sysinfo>
Nov 18 15:50:29 user nova-compute[74839]:   <os>
Nov 18 15:50:29 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:50:29 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:50:29 user nova-compute[74839]:   </os>
Nov 18 15:50:29 user nova-compute[74839]:   <features>
Nov 18 15:50:29 user nova-compute[74839]:     <acpi/>
Nov 18 15:50:29 user nova-compute[74839]:     <apic/>
Nov 18 15:50:29 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:50:29 user nova-compute[74839]:   </features>
Nov 18 15:50:29 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:50:29 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:50:29 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:50:29 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:50:29 user nova-compute[74839]:   </clock>
Nov 18 15:50:29 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:50:29 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:50:29 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:50:29 user nova-compute[74839]:   </cpu>
Nov 18 15:50:29 user nova-compute[74839]:   <devices>
Nov 18 15:50:29 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:50:29 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:50:29 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue"/>
Nov 18 15:50:29 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:50:29 user nova-compute[74839]:     </disk>
Nov 18 15:50:29 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:50:29 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:50:29 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk"/>
Nov 18 15:50:29 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 15:50:29 user nova-compute[74839]:     </disk>
Nov 18 15:50:29 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:50:29 user nova-compute[74839]:       <mac address="fa:16:3e:31:2b:cb"/>
Nov 18 15:50:29 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:29 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:50:29 user nova-compute[74839]:       <target dev="tap25445020-24"/>
Nov 18 15:50:29 user nova-compute[74839]:     </interface>
Nov 18 15:50:29 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:50:29 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/console.log" append="off"/>
Nov 18 15:50:29 user nova-compute[74839]:     </serial>
Nov 18 15:50:29 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:50:29 user nova-compute[74839]:     <video>
Nov 18 15:50:29 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:50:29 user nova-compute[74839]:     </video>
Nov 18 15:50:29 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:50:29 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:50:29 user nova-compute[74839]:     </rng>
Nov 18 15:50:29 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:50:29 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:50:29 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:50:29 user nova-compute[74839]:     </memballoon>
Nov 18 15:50:29 user nova-compute[74839]:   </devices>
Nov 18 15:50:29 user nova-compute[74839]: </domain>
Nov 18 15:50:29 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:50:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance destroyed successfully.
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:50:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] No VIF found with MAC fa:16:3e:31:2b:cb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:30 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:30 user nova-compute[74839]: WARNING nova.compute.manager [req-f8a9b264-8660-42fc-a3ab-9067d0bcfdb1 req-fb26c257-8959-4c53-a368-73c2e2a7aa9d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state active and task_state rescuing.
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:33 user nova-compute[74839]: WARNING nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state active and task_state rescuing.
Nov 18 15:50:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:50:33 user nova-compute[74839]: WARNING nova.compute.manager [req-40415707-1ddb-4b56-b238-a51d4cfac126 req-a2d7532f-fd3f-404b-ab88-c140a419531a service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state active and task_state rescuing.
Nov 18 15:50:33 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b48d2f87-9fc6-4853-8667-adbfed2fbe1a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:50:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:45 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [{"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-df4b8778-e410-4771-99f8-eefb3aeb39d2" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:50:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:50 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:50:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:50:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.025386810302734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Applying migration context for instance 31053684-0b7e-476a-ad00-75855f339d6e as it has an incoming, in-progress migration 0a615fb1-27e2-499d-87e1-c5a960d87916. Migration status is finished {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 15:50:55 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating resource usage from migration 0a615fb1-27e2-499d-87e1-c5a960d87916
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Migration 0a615fb1-27e2-499d-87e1-c5a960d87916 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:50:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:50:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:50:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:50:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing instance network info cache due to event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:51:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] Acquiring lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:51:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] Acquired lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:51:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:51:08 user nova-compute[74839]: INFO nova.compute.claims [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Claim successful on node user
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updated VIF entry in instance network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating instance_info_cache with network_info: [{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59cdb452-ed1c-4c7a-9ba3-14beff69b46b req-a43cfabf-4e6c-4c17-902d-4991d28fe681 service nova] Releasing lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:08 user nova-compute[74839]: INFO nova.compute.manager [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Attaching volume 317df658-795b-4a8a-8c81-084bff044d21 to /dev/vdb
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG os_brick.utils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62abf37-09bc-471b-b751-e2d4c088291a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:51:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2829110f-e8ab-4b8f-bda9-115528eb008a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fab54a-8c60-498f-9e53-8e01b3a40eaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dcc28a-7346-425d-97d9-6f094df3bd48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:51:09 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71afe414-f55c-4293-82fd-e0183b35ad53]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG os_brick.utils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating existing volume attachment record: dc7f1f0f-3010-49a6-b572-fff0de728a5e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:51:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.policy [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff8831a016994a20afe7ad8895359ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce9324fb3f44158a16106b220d60a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:51:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Creating image(s)
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "/opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "/opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "/opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk 1073741824" returned: 0 in 0.235s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.414s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Successfully created port: 59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Cannot resize image /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Ensure instance console log exists: /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Successfully updated port: 59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquired lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-changed-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Refreshing instance network info cache due to event network-changed-59918e6d-bdf9-41dd-a107-f1e75278eb6f. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] Acquiring lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:51:10 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.neutron [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating instance_info_cache with network_info: [{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Releasing lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Instance network_info: |[{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] Acquired lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Refreshing network info cache for port 59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Start _get_guest_xml network_info=[{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:51:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:51:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1546383011',display_name='tempest-SnapshotDataIntegrityTests-server-1546383011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1546383011',id=37,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGig1frpyOLiNrzfWduRs1Xn7b7FkR/t0AQaUiPCVz6T6++OsNk6loO15BKdq1PvDQOqaRy9wnD1OBvCGifrMgnYasrr5sUHG693t8p5PPlGJG7KXDpYpaS74+CPvKyKMA==',key_name='tempest-keypair-1329986613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce9324fb3f44158a16106b220d60a46',ramdisk_id='',reservation_id='r-uv4ymkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-799976396',owner_user_name='tempest-SnapshotDataIntegrityTests-799976396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8831a016994a20afe7ad8895359ca4',uuid=1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converting VIF {"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'pci_devices' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:51:11 user nova-compute[74839]:   <uuid>1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd</uuid>
Nov 18 15:51:11 user nova-compute[74839]:   <name>instance-00000025</name>
Nov 18 15:51:11 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:51:11 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:51:11 user nova-compute[74839]:   <metadata>
Nov 18 15:51:11 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:51:11 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1546383011</nova:name>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:51:11</nova:creationTime>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:51:11 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:51:11 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:owner>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:user uuid="ff8831a016994a20afe7ad8895359ca4">tempest-SnapshotDataIntegrityTests-799976396-project-member</nova:user>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:project uuid="0ce9324fb3f44158a16106b220d60a46">tempest-SnapshotDataIntegrityTests-799976396</nova:project>
Nov 18 15:51:11 user nova-compute[74839]:       </nova:owner>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:51:11 user nova-compute[74839]:       <nova:ports>
Nov 18 15:51:11 user nova-compute[74839]:         <nova:port uuid="59918e6d-bdf9-41dd-a107-f1e75278eb6f">
Nov 18 15:51:11 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 15:51:11 user nova-compute[74839]:         </nova:port>
Nov 18 15:51:11 user nova-compute[74839]:       </nova:ports>
Nov 18 15:51:11 user nova-compute[74839]:     </nova:instance>
Nov 18 15:51:11 user nova-compute[74839]:   </metadata>
Nov 18 15:51:11 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:51:11 user nova-compute[74839]:     <system>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="serial">1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd</entry>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="uuid">1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd</entry>
Nov 18 15:51:11 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:51:11 user nova-compute[74839]:     </system>
Nov 18 15:51:11 user nova-compute[74839]:   </sysinfo>
Nov 18 15:51:11 user nova-compute[74839]:   <os>
Nov 18 15:51:11 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:51:11 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:51:11 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:51:11 user nova-compute[74839]:   </os>
Nov 18 15:51:11 user nova-compute[74839]:   <features>
Nov 18 15:51:11 user nova-compute[74839]:     <acpi/>
Nov 18 15:51:11 user nova-compute[74839]:     <apic/>
Nov 18 15:51:11 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:51:11 user nova-compute[74839]:   </features>
Nov 18 15:51:11 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:51:11 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:51:11 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:51:11 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:51:11 user nova-compute[74839]:   </clock>
Nov 18 15:51:11 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:51:11 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:51:11 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:51:11 user nova-compute[74839]:   </cpu>
Nov 18 15:51:11 user nova-compute[74839]:   <devices>
Nov 18 15:51:11 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:51:11 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:51:11 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk"/>
Nov 18 15:51:11 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:51:11 user nova-compute[74839]:     </disk>
Nov 18 15:51:11 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:51:11 user nova-compute[74839]:       <mac address="fa:16:3e:1f:0b:7c"/>
Nov 18 15:51:11 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:51:11 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:51:11 user nova-compute[74839]:       <target dev="tap59918e6d-bd"/>
Nov 18 15:51:11 user nova-compute[74839]:     </interface>
Nov 18 15:51:11 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:51:11 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/console.log" append="off"/>
Nov 18 15:51:11 user nova-compute[74839]:     </serial>
Nov 18 15:51:11 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:51:11 user nova-compute[74839]:     <video>
Nov 18 15:51:11 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:51:11 user nova-compute[74839]:     </video>
Nov 18 15:51:11 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:51:11 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:51:11 user nova-compute[74839]:     </rng>
Nov 18 15:51:11 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:51:11 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:51:11 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:51:11 user nova-compute[74839]:     </memballoon>
Nov 18 15:51:11 user nova-compute[74839]:   </devices>
Nov 18 15:51:11 user nova-compute[74839]: </domain>
Nov 18 15:51:11 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1546383011',display_name='tempest-SnapshotDataIntegrityTests-server-1546383011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1546383011',id=37,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGig1frpyOLiNrzfWduRs1Xn7b7FkR/t0AQaUiPCVz6T6++OsNk6loO15BKdq1PvDQOqaRy9wnD1OBvCGifrMgnYasrr5sUHG693t8p5PPlGJG7KXDpYpaS74+CPvKyKMA==',key_name='tempest-keypair-1329986613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce9324fb3f44158a16106b220d60a46',ramdisk_id='',reservation_id='r-uv4ymkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-799976396',owner_user_name='tempest-SnapshotDataIntegrityTests-799976396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8831a016994a20afe7ad8895359ca4',uuid=1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converting VIF {"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG os_vif [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3506c494-ab8e-5cb1-9755-40275e7f22e1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59918e6d-bd, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59918e6d-bd, col_values=(('qos', UUID('d0fd747f-7e10-473f-9669-ee37e65181da')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59918e6d-bd, col_values=(('external_ids', {'iface-id': '59918e6d-bdf9-41dd-a107-f1e75278eb6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:0b:7c', 'vm-uuid': '1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:11 user nova-compute[74839]: INFO os_vif [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd')
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No VIF found with MAC fa:16:3e:1f:0b:7c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updated VIF entry in instance network info cache for port 59918e6d-bdf9-41dd-a107-f1e75278eb6f. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating instance_info_cache with network_info: [{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:51:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8c086733-da3c-4e31-bca9-66041cf88518 req-7074a065-19e3-48d3-b873-e314598f8b25 service nova] Releasing lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:12 user nova-compute[74839]: INFO nova.compute.manager [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Terminating instance
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] No waiting events found dispatching network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:51:12 user nova-compute[74839]: WARNING nova.compute.manager [req-10f49c17-1a0e-4bd5-936c-227a033d0650 req-4846396f-f1e6-41bc-a224-b7155a8eeaaf service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received unexpected event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f for instance with vm_state building and task_state spawning.
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-unplugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] No waiting events found dispatching network-vif-unplugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:51:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-5e8f4ebb-ef9a-412c-a300-5b65d2d96645 req-6982be3e-d139-4c9c-b6fa-97ab25a80d0c service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-unplugged-1d161523-2904-4c91-bce6-00b824139d03 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Instance destroyed successfully.
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.objects.instance [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lazy-loading 'resources' on Instance uuid 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:31:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-257681794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-257681794',id=1,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0b5e1598374e26b3b0c081e6ca38d3',ramdisk_id='',reservation_id='r-g1cf06ow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:33:32Z,user_data=None,user_id='a1b86e5899c041e88609206af0613940',uuid=7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converting VIF {"id": "1d161523-2904-4c91-bce6-00b824139d03", "address": "fa:16:3e:58:6c:11", "network": {"id": "16d3e023-d109-445e-8a4f-bffb66bf4c11", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1539348105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0b5e1598374e26b3b0c081e6ca38d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d161523-29", "ovs_interfaceid": "1d161523-2904-4c91-bce6-00b824139d03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG os_vif [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d161523-29, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb3c61af-dd02-4f20-961a-149835c051ad) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: INFO os_vif [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:6c:11,bridge_name='br-int',has_traffic_filtering=True,id=1d161523-2904-4c91-bce6-00b824139d03,network=Network(16d3e023-d109-445e-8a4f-bffb66bf4c11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d161523-29')
Nov 18 15:51:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Deleting instance files /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5_del
Nov 18 15:51:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Deletion of /opt/stack/data/nova/instances/7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5_del complete
Nov 18 15:51:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:13 user nova-compute[74839]: INFO nova.compute.manager [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 18 15:51:13 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:51:13 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Took 0.41 seconds to deallocate network for instance.
Nov 18 15:51:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-e6b190de-c69d-46f0-9534-96dca678f863 req-90097c34-b8f9-4023-9e83-9b9c0abebc96 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-deleted-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:14 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Deleted allocations for instance 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-52e224c1-6425-429d-a674-3cb8d3fb551c tempest-ServerBootFromVolumeStableRescueTest-1367062949 tempest-ServerBootFromVolumeStableRescueTest-1367062949-project-member] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpDqZjhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:51:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:51:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:51:14 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ff755-6bc0-4c6c-9b39-e4481626917b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:51:14 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf0360-a189-4338-889f-2b231447b971]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21] added
Nov 18 15:51:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c41bc64-fecd-4457-9e29-6029abdc31a5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c59432-3ba3-4e49-87d1-5d5426010689]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpDqZjhg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpDqZjhg" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407602d-34e3-4386-a0f9-425f5fef71a4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpDqZjhg'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f64ae6-a4fc-49f1-b409-f949c2d55bcb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] No waiting events found dispatching network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:51:14 user nova-compute[74839]: WARNING nova.compute.manager [req-2d95f015-34b3-4ba8-b00b-af731714a180 req-59f89dfe-fa09-4c0b-a9d9-7278be974d7f service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received unexpected event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f for instance with vm_state building and task_state spawning.
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb35f2-f907-428c-b0ef-aea186ccd01f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:14 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:14 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] Acquiring lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] Lock "7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG nova.compute.manager [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] No waiting events found dispatching network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:51:14 user nova-compute[74839]: WARNING nova.compute.manager [req-165b198d-00c4-4c4f-94f6-36ac159c77ff req-1c41c3f9-9e51-4dff-85a6-ed774a07eea9 service nova] [instance: 7276f0a0-1a3e-42ba-868a-8cc8bb48fcb5] Received unexpected event network-vif-plugged-1d161523-2904-4c91-bce6-00b824139d03 for instance with vm_state deleted and task_state None.
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcb0b28-c973-46dd-b1d7-fac2614799a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260]
Nov 18 15:51:15 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260] successful.
Nov 18 15:51:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec8bcf-9341-4b32-af01-cee8d8f166f3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7f62bc-1102-45ce-beda-55f5e2be834b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:15 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:15 user nova-compute[74839]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)
Nov 18 15:51:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:15 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:15 user nova-compute[74839]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)
Nov 18 15:51:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49acd6f-e1b2-4b7e-aa52-d98f6d7446ab]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpDqZjhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:51:15 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Instance spawned successfully.
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:51:15 user nova-compute[74839]: INFO nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 18 15:51:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:51:15 user nova-compute[74839]: INFO nova.compute.manager [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Took 6.84 seconds to build instance.
Nov 18 15:51:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7091f414-ca4d-4dd1-880a-e0e734944b63 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.008s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26366663830616131', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663830616131', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:51:16 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:51:16 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:51:16 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:51:16 user nova-compute[74839]:   <serial>317df658-795b-4a8a-8c81-084bff044d21</serial>
Nov 18 15:51:16 user nova-compute[74839]: </disk>
Nov 18 15:51:16 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] No VIF found with MAC fa:16:3e:cf:e7:0d, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:51:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f5a3d76f-fc58-442c-b246-cf2f4f236f62 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.782s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:18 user nova-compute[74839]: INFO nova.compute.manager [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Detaching volume 317df658-795b-4a8a-8c81-084bff044d21
Nov 18 15:51:18 user nova-compute[74839]: INFO nova.virt.block_device [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Attempting to driver detach volume 317df658-795b-4a8a-8c81-084bff044d21 from mountpoint /dev/vdb
Nov 18 15:51:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Attempting to detach device vdb from instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:51:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:51:18 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:51:18 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:51:18 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:51:18 user nova-compute[74839]:   <serial>317df658-795b-4a8a-8c81-084bff044d21</serial>
Nov 18 15:51:18 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:51:18 user nova-compute[74839]: </disk>
Nov 18 15:51:18 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:51:18 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully detached device vdb from instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 from the persistent domain config.
Nov 18 15:51:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:51:18 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:51:18 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:51:18 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:51:18 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:51:18 user nova-compute[74839]:   <serial>317df658-795b-4a8a-8c81-084bff044d21</serial>
Nov 18 15:51:18 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:51:18 user nova-compute[74839]: </disk>
Nov 18 15:51:18 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:51:19 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:51:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 is timed out.
Nov 18 15:51:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully detached device vdb from instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 from the live domain config.
Nov 18 15:51:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpDqZjhg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:51:39 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee66dc-1067-4fd0-9680-a2baa89a8ea3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:51:39 user nova-compute[74839]: No targets found.
Nov 18 15:51:39 user nova-compute[74839]: iSNS:
Nov 18 15:51:39 user nova-compute[74839]: No targets found.
Nov 18 15:51:39 user nova-compute[74839]: STATIC:
Nov 18 15:51:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:51:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:51:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:51:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21
Nov 18 15:51:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:51:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:51:39 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:51:39 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:51:39 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:51:39 user nova-compute[74839]: FIRMWARE:
Nov 18 15:51:39 user nova-compute[74839]: No targets found.
Nov 18 15:51:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:51:39 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:51:39 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a437bc-0b6d-4ef7-a357-46ccff815e17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f6091-5e9e-4e8c-8516-249cc9cd0d1f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:39 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:39 user nova-compute[74839]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)
Nov 18 15:51:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:51:39 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:51:39 user nova-compute[74839]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 (non-flash)
Nov 18 15:51:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a4292050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3502007d-c5fb-4a95-9f16-4019ef877db9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9611c-3fae-4549-9671-a28df6a997af]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f265f-590c-4d2f-b2bb-aeeb28a625de]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4957f0-efb8-4840-b4fc-ab0fdd6af07f]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a6332-c2d3-450e-805f-1536a3c87bf3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ba511-e4bf-400a-a463-575dfa24e5ec]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260]
Nov 18 15:51:39 user nova-compute[74839]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21, portal: 172.16.0.220,3260] successful.
Nov 18 15:51:39 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:317df658-795b-4a8a-8c81-084bff044d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e6e926-a322-4e3a-a27e-b7f131859d0b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] <== disconnect_volume: return (312ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:51:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:51:40 user nova-compute[74839]: DEBUG nova.objects.instance [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'flavor' on Instance uuid c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:51:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-380e5998-dd29-4a2f-9f7f-032e33560997 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:46 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [{"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-defa77fc-949a-4b92-b717-559fa24b7a2c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:51:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:51:49 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:52 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:51:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:51:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:51:57 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:51:57 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.118850708007812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Applying migration context for instance 31053684-0b7e-476a-ad00-75855f339d6e as it has an incoming, in-progress migration 0a615fb1-27e2-499d-87e1-c5a960d87916. Migration status is finished {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 18 15:51:57 user nova-compute[74839]: INFO nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating resource usage from migration 0a615fb1-27e2-499d-87e1-c5a960d87916
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Migration 0a615fb1-27e2-499d-87e1-c5a960d87916 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:51:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:51:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:51:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:51:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Going to confirm migration 2 {{(pid=74839) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'info_cache' on Instance uuid 31053684-0b7e-476a-ad00-75855f339d6e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'migration_context' on Instance uuid 31053684-0b7e-476a-ad00-75855f339d6e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Object Instance<31053684-0b7e-476a-ad00-75855f339d6e> lazy-loaded attributes: info_cache,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:52:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:52:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.424s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:03 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Deleted allocation for migration 0a615fb1-27e2-499d-87e1-c5a960d87916
Nov 18 15:52:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-75b8f7f8-028b-4a05-ac9d-2dcd48b687f9 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.406s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-changed-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Refreshing instance network info cache due to event network-changed-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:52:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] Acquiring lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] Acquired lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Refreshing network info cache for port f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:52:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updated VIF entry in instance network info cache for port f7afa2a4-1cd0-41e6-b390-98c5ba25cda2. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:52:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating instance_info_cache with network_info: [{"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f8cf5886-5fa5-4a61-a006-57d6bd28f0d5 req-bb791f77-be4d-4159-8a29-712b1fa8ded3 service nova] Releasing lock "refresh_cache-d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.objects.instance [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Ignoring supplied device name: /dev/vdb
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:09 user nova-compute[74839]: INFO nova.compute.manager [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Attaching volume 71574d33-7f97-4323-813c-9687455ef5c5 to /dev/vdb
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.utils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6a5db-caf4-4f63-b7f1-c67d69d03924]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[17832de7-f483-48fc-8b72-ab9873aaf33a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[718568ea-9af2-4566-a73c-08c2228f6793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657aa6b-d9f2-4fb9-aef6-a0b3905cff40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:52:09 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf54218-5131-4ac6-a1a0-a1fe2c989fe7]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG os_brick.utils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating existing volume attachment record: b6a390b1-e604-48a5-8522-aeff2c939e28 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing instance network info cache due to event network-changed-38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] Acquiring lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] Acquired lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.network.neutron [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Refreshing network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:52:09 user nova-compute[74839]: INFO nova.compute.manager [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Terminating instance
Nov 18 15:52:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-unplugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] No waiting events found dispatching network-vif-unplugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-f5af7cd0-d759-4eb6-8f3c-293fb46066fa req-172f3749-318a-44cf-8e51-0773c74056b1 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-unplugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updated VIF entry in instance network info cache for port 38a62d3f-69a3-4c7b-a051-5d84bb82923b. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating instance_info_cache with network_info: [{"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bad85a47-3f97-4cf2-a896-60ef7e2d0b57 req-92d9719c-cb67-4e91-abd3-a25c290d6530 service nova] Releasing lock "refresh_cache-c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:10 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Instance destroyed successfully.
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'resources' on Instance uuid c075fc5d-3e79-44bf-a5a1-ff4bf488ca27 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:49:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2045186579',display_name='tempest-TestStampPattern-server-2045186579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2045186579',id=35,image_ref='88272694-1f97-459f-bef2-e1f31fd9e4c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:49:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-vcx06x8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='262be841-6b58-4075-832e-0e67a155c4aa',image_min_disk='1',image_min_ram='0',image_owner_id='56fb5852e010490a872cd924843da9b7',image_owner_project_name='tempest-TestStampPattern-1229984930',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1229984930-project-member',image_user_id='3a69cbda04c24c82b9d219c41bc524b4',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:49:23Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=c075fc5d-3e79-44bf-a5a1-ff4bf488ca27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "address": "fa:16:3e:cf:e7:0d", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a62d3f-69", "ovs_interfaceid": "38a62d3f-69a3-4c7b-a051-5d84bb82923b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG os_vif [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a62d3f-69, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a55791fa-2574-4589-a24e-9d8d18577120) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:10 user nova-compute[74839]: INFO os_vif [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e7:0d,bridge_name='br-int',has_traffic_filtering=True,id=38a62d3f-69a3-4c7b-a051-5d84bb82923b,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a62d3f-69')
Nov 18 15:52:10 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Deleting instance files /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27_del
Nov 18 15:52:10 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Deletion of /opt/stack/data/nova/instances/c075fc5d-3e79-44bf-a5a1-ff4bf488ca27_del complete
Nov 18 15:52:10 user nova-compute[74839]: INFO nova.compute.manager [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 15:52:10 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:52:10 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:52:11 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:11 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Took 0.45 seconds to deallocate network for instance.
Nov 18 15:52:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:11 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:52:11 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:52:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:11 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Deleted allocations for instance c075fc5d-3e79-44bf-a5a1-ff4bf488ca27
Nov 18 15:52:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b8e541a-b608-4dfe-b34b-5e45b62a6181 tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.899s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] Acquiring lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] Lock "c075fc5d-3e79-44bf-a5a1-ff4bf488ca27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] No waiting events found dispatching network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:12 user nova-compute[74839]: WARNING nova.compute.manager [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received unexpected event network-vif-plugged-38a62d3f-69a3-4c7b-a051-5d84bb82923b for instance with vm_state deleted and task_state None.
Nov 18 15:52:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3c0b66a8-dd25-411e-8b00-81885e6b7035 req-f07f10b4-5c34-454f-bff5-8f3f6b1208fa service nova] [instance: c075fc5d-3e79-44bf-a5a1-ff4bf488ca27] Received event network-vif-deleted-38a62d3f-69a3-4c7b-a051-5d84bb82923b {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrYSmaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:52:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:52:14 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:52:14 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9620b-c1be-4f6e-b38f-43eb90bedde6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:52:14 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f521d5-8a0a-472c-a6cf-c18c29bfa9fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5] added
Nov 18 15:52:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93c4c4-4364-4583-8319-4d0754a82bf8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268d125-891d-4a7a-90e5-a68cb8fe75e8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrYSmaPd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrYSmaPd" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c53d8-e8bb-405c-bcd9-429ec150e58f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrYSmaPd'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9f5240-9cb9-4044-827f-e85e4deb56c1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac680cb-c8a0-4566-9366-e5f20f45a1a1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:14 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:14 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:14 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:52:14 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5302d1-06fb-42a4-afa2-bfb7871b45c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260]
Nov 18 15:52:15 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260] successful.
Nov 18 15:52:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[767dc6e2-f3db-42dd-8f29-ed435f5aafe5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2e9af-15e5-4c33-9ad1-30d67dd03e1a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:15 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:15 user nova-compute[74839]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)
Nov 18 15:52:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:15 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:15 user nova-compute[74839]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)
Nov 18 15:52:15 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13fbc4-cfc8-4b28-9e90-c3e444fd73a9]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrYSmaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26435653138363634', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435653138363634', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:52:16 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:52:16 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:52:16 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:52:16 user nova-compute[74839]:   <serial>71574d33-7f97-4323-813c-9687455ef5c5</serial>
Nov 18 15:52:16 user nova-compute[74839]: </disk>
Nov 18 15:52:16 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No VIF found with MAC fa:16:3e:8a:43:93, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:52:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-93189ba3-5bfd-4b95-a24e-f8d570dc3cfe tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.375s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:18 user nova-compute[74839]: INFO nova.compute.manager [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Unrescuing
Nov 18 15:52:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:18 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'flavor' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG nova.compute.manager [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:19 user nova-compute[74839]: WARNING nova.compute.manager [req-c9ad7ed6-5ae1-4b53-b09c-1c02e2714451 req-c5b1c20e-74a3-4461-b594-4d81721c689b service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:52:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance destroyed successfully.
Nov 18 15:52:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:21 user nova-compute[74839]: WARNING nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:21 user nova-compute[74839]: WARNING nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:21 user nova-compute[74839]: WARNING nova.compute.manager [req-9c095fc3-a8e9-4c86-a6e3-5162bcb2100a req-bb7a7d66-a01c-437f-8132-c83c0da6f8c9 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state rescued and task_state unrescuing.
Nov 18 15:52:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a49a7069-d09e-4bb2-a2b9-bbf996fdf02a tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:52:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:31 user nova-compute[74839]: INFO nova.compute.manager [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Detaching volume 71574d33-7f97-4323-813c-9687455ef5c5
Nov 18 15:52:31 user nova-compute[74839]: INFO nova.virt.block_device [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Attempting to driver detach volume 71574d33-7f97-4323-813c-9687455ef5c5 from mountpoint /dev/vdb
Nov 18 15:52:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Attempting to detach device vdb from instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:52:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:52:31 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:52:31 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:52:31 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:52:31 user nova-compute[74839]:   <serial>71574d33-7f97-4323-813c-9687455ef5c5</serial>
Nov 18 15:52:31 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:52:31 user nova-compute[74839]: </disk>
Nov 18 15:52:31 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:52:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully detached device vdb from instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e from the persistent domain config.
Nov 18 15:52:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:52:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:52:31 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:52:31 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:52:31 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:52:31 user nova-compute[74839]:   <serial>71574d33-7f97-4323-813c-9687455ef5c5</serial>
Nov 18 15:52:31 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:52:31 user nova-compute[74839]: </disk>
Nov 18 15:52:31 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:52:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:47 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:52:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:52:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:48 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [{"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-ab26071c-3fb0-4d46-8742-319d53f5a6c3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:52:49 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:52:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:52:52 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e is timed out.
Nov 18 15:52:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully detached device vdb from instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e from the live domain config.
Nov 18 15:52:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrYSmaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:52:52 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029c4f8-6021-47c4-8c2c-6aaadc9d3b7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:52:52 user nova-compute[74839]: No targets found.
Nov 18 15:52:52 user nova-compute[74839]: iSNS:
Nov 18 15:52:52 user nova-compute[74839]: No targets found.
Nov 18 15:52:52 user nova-compute[74839]: STATIC:
Nov 18 15:52:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5
Nov 18 15:52:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:52:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:52:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:52:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:52:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:52:52 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:52:52 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:52:52 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:52:52 user nova-compute[74839]: FIRMWARE:
Nov 18 15:52:52 user nova-compute[74839]: No targets found.
Nov 18 15:52:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:52:52 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:52:52 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e228be6-19c1-49af-9ddc-86f028175c69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0e667-8e4c-4dfd-9092-cbf049f7a4bf]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:52 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:52 user nova-compute[74839]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)
Nov 18 15:52:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:52 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:52 user nova-compute[74839]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 (non-flash)
Nov 18 15:52:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480268280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[819a6a22-758f-4530-9ce5-e8ecd39a12a9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce225a87-696b-494a-a575-4a9e94ccf4f6]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f571da-0774-414f-9ec1-aac5b19b21a6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4f031-5ae0-4426-a488-f4bf807be2da]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f7c9f-3eef-456c-a5b0-3498f26068e7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ccc20-cea5-4a0a-a106-ed34ce6dfde0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260]
Nov 18 15:52:52 user nova-compute[74839]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5, portal: 172.16.0.220,3260] successful.
Nov 18 15:52:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e81d51-eac5-4599-80f0-b3a9c478299b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== disconnect_volume: return (306ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:52:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ab92c22c-ff11-4747-9059-b9808270121e tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.512s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:53 user nova-compute[74839]: INFO nova.compute.manager [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Terminating instance
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-unplugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] No waiting events found dispatching network-vif-unplugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-a6ccdae6-2bd9-4838-8097-3517a1f6a7c6 req-92313cea-18f2-4b17-9400-3f63efa35fdf service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-unplugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:52:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Instance destroyed successfully.
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'resources' on Instance uuid d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:50:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-360640106',display_name='tempest-VolumesSnapshotTestJSON-instance-360640106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-360640106',id=36,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5/gGqg9pOYZ9979iWUq60Pd6lk0r1TNmmFiJhJcmJMwumvBwLBqJ9dErI+hvM8eQBrfcaryBnWZLLsN19Nlh/eBFAi9CbdjzJkzJPcmlvAWZloc4sAn99zyiGdITN4g==',key_name='tempest-keypair-1744632358',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:50:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-hkoj1bi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "address": "fa:16:3e:8a:43:93", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7afa2a4-1c", "ovs_interfaceid": "f7afa2a4-1cd0-41e6-b390-98c5ba25cda2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_vif [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7afa2a4-1c, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f47aeb8a-b583-40f5-bc5c-57dbe326080a) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:53 user nova-compute[74839]: INFO os_vif [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:43:93,bridge_name='br-int',has_traffic_filtering=True,id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7afa2a4-1c')
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrYSmaPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:52:53 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccfee47-4bee-4a43-a17c-e0dd62b961a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:52:53 user nova-compute[74839]: No targets found.
Nov 18 15:52:53 user nova-compute[74839]: iSNS:
Nov 18 15:52:53 user nova-compute[74839]: No targets found.
Nov 18 15:52:53 user nova-compute[74839]: STATIC:
Nov 18 15:52:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:52:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:52:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:52:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:52:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:52:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:52:53 user nova-compute[74839]: FIRMWARE:
Nov 18 15:52:53 user nova-compute[74839]: No targets found.
Nov 18 15:52:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:52:53 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:52:53 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574d33-7f97-4323-813c-9687455ef5c5', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3e6937-0ecb-44d8-9f48-ee976059a2e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:53 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56816d3d-b898-454b-ad53-2cf03a2c06ef]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:54 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:52:54 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:52:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a11e3eb0>, {}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Disconnecting from: [] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== disconnect_volume: return (81ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Deleting instance files /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e_del
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Deletion of /opt/stack/data/nova/instances/d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e_del complete
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.compute.manager [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-17caade4-1454-4fe0-b11f-4b2534734d89 req-f874d96f-5b07-4881-9387-676071c7c290 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-deleted-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.compute.manager [req-17caade4-1454-4fe0-b11f-4b2534734d89 req-f874d96f-5b07-4881-9387-676071c7c290 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Neutron deleted interface f7afa2a4-1cd0-41e6-b390-98c5ba25cda2; detaching it from the instance and deleting it from the info cache
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-17caade4-1454-4fe0-b11f-4b2534734d89 req-f874d96f-5b07-4881-9387-676071c7c290 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Took 0.70 seconds to deallocate network for instance.
Nov 18 15:52:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-17caade4-1454-4fe0-b11f-4b2534734d89 req-f874d96f-5b07-4881-9387-676071c7c290 service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Detach interface failed, port_id=f7afa2a4-1cd0-41e6-b390-98c5ba25cda2, reason: Instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:54 user nova-compute[74839]: WARNING nova.volume.cinder [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Attachment b6a390b1-e604-48a5-8522-aeff2c939e28 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b6a390b1-e604-48a5-8522-aeff2c939e28. (HTTP 404) (Request-ID: req-bc8393a9-c338-420f-8fcd-62346b95a0d7)
Nov 18 15:52:54 user nova-compute[74839]: INFO nova.compute.manager [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Took 0.07 seconds to detach 1 volumes for instance.
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] Acquiring lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] No waiting events found dispatching network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:52:55 user nova-compute[74839]: WARNING nova.compute.manager [req-63049a13-1beb-420b-b11a-5ab75d65a8bc req-ae85d8d9-2ce4-4ff0-8888-4ce6997db11a service nova] [instance: d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e] Received unexpected event network-vif-plugged-f7afa2a4-1cd0-41e6-b390-98c5ba25cda2 for instance with vm_state deleted and task_state None.
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:52:55 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid 'd55c820c-6b1a-40f1-8c9d-275b1b7b8c9e' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd55c820c-6b1a-40f1-8c9d-275b1b7b8c9e' (instance-00000024)
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.702s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:55 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Deleted allocations for instance d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b340b7a3-318b-4d18-b18e-8ae34e50ac1c tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "d55c820c-6b1a-40f1-8c9d-275b1b7b8c9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:52:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:52:57 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:52:57 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.10062026977539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 262be841-6b58-4075-832e-0e67a155c4aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:52:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:52:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-changed-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Refreshing instance network info cache due to event network-changed-59918e6d-bdf9-41dd-a107-f1e75278eb6f. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] Acquiring lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] Acquired lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Refreshing network info cache for port 59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updated VIF entry in instance network info cache for port 59918e6d-bdf9-41dd-a107-f1e75278eb6f. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating instance_info_cache with network_info: [{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-310f547e-40c7-4013-88c0-873072917999 req-f3492b59-c0c8-4c53-9deb-f0a54bb7eca0 service nova] Releasing lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:52:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:03 user nova-compute[74839]: INFO nova.compute.manager [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attaching volume 35e4a55a-a125-4b0a-965c-206f49d88585 to /dev/vdb
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6c5df-edfa-47e6-ab73-e9eeaecfbfc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[142933ad-dfcb-4e52-b133-b0c6a32a9408]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9db170-583f-4f70-833b-25dee7c6ab3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1f21a1-5d96-45f5-8aaf-3b8a46634fd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:53:03 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:53:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9398d2-8f2a-4586-b6ab-a83ebd228c4e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating existing volume attachment record: 2a587ff6-f3a3-4d0f-89b9-c381fa697f60 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:53:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-changed-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing instance network info cache due to event network-changed-9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] Acquiring lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] Acquired lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Refreshing network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:07 user nova-compute[74839]: INFO nova.compute.manager [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Terminating instance
Nov 18 15:53:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-unplugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] No waiting events found dispatching network-vif-unplugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.compute.manager [req-15e1bf4c-09c4-4d8f-a988-35ba4b8c768e req-f5063ff1-d84d-42b2-8583-39a5e9a66675 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-unplugged-9a620a55-1720-40be-a227-58e69797c8b4 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:53:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Instance destroyed successfully.
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lazy-loading 'resources' on Instance uuid 262be841-6b58-4075-832e-0e67a155c4aa {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1963006210',display_name='tempest-TestStampPattern-server-1963006210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1963006210',id=30,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaN56OyKxHzST+vBMcffWn7u3mCydjmSdaXG7GdH+PzvdFWuSyOhFUw0o8F8CXFqb1VrHoV8ptXr37Ch3YfXLP0oQptivm+B9zdREQjwsQIZ4DFSh21F/zmL3Z2thMqIA==',key_name='tempest-TestStampPattern-1419190154',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56fb5852e010490a872cd924843da9b7',ramdisk_id='',reservation_id='r-v0xkpczt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1229984930',owner_user_name='tempest-TestStampPattern-1229984930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:49:13Z,user_data=None,user_id='3a69cbda04c24c82b9d219c41bc524b4',uuid=262be841-6b58-4075-832e-0e67a155c4aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converting VIF {"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG os_vif [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a620a55-17, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f8cc29c-155a-499a-aa39-79d8dca23521) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:08 user nova-compute[74839]: INFO os_vif [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:4b:0c,bridge_name='br-int',has_traffic_filtering=True,id=9a620a55-1720-40be-a227-58e69797c8b4,network=Network(5e8da5f8-6b7d-4735-a3f1-f6237f5cd994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a620a55-17')
Nov 18 15:53:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Deleting instance files /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa_del
Nov 18 15:53:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Deletion of /opt/stack/data/nova/instances/262be841-6b58-4075-832e-0e67a155c4aa_del complete
Nov 18 15:53:08 user nova-compute[74839]: INFO nova.compute.manager [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 15:53:08 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updated VIF entry in instance network info cache for port 9a620a55-1720-40be-a227-58e69797c8b4. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating instance_info_cache with network_info: [{"id": "9a620a55-1720-40be-a227-58e69797c8b4", "address": "fa:16:3e:46:4b:0c", "network": {"id": "5e8da5f8-6b7d-4735-a3f1-f6237f5cd994", "bridge": "br-int", "label": "tempest-TestStampPattern-379533522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56fb5852e010490a872cd924843da9b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a620a55-17", "ovs_interfaceid": "9a620a55-1720-40be-a227-58e69797c8b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3f662f3c-2893-4b0e-8be5-81ad2a912939 req-8dc89365-9c30-471b-8dcb-4d70f6ddd320 service nova] Releasing lock "refresh_cache-262be841-6b58-4075-832e-0e67a155c4aa" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snLCYZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:53:09 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:53:09 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:53:09 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[28666e88-3d1e-4abf-bec6-65526a995dc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:53:09 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4ea58-f95f-4a3b-bc35-bc1a8357164d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585] added
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a81a85-902d-442a-84a4-f11483340cae]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f94d4d-cb2c-441b-ba54-02fbadf35382]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snLCYZoK {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:09 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Took 0.62 seconds to deallocate network for instance.
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snLCYZoK" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4af3e02-3496-4e9b-a130-398ee91cb973]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snLCYZoK'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f575c0f-cd50-4d2a-b6c7-b37a4a2756c8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9c4f0-1268-461e-a32f-b25de3b321fd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3425c1-5288-4f4a-b1bd-3a2147904e3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260]
Nov 18 15:53:09 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260] successful.
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4f68d-78d3-48df-a9e6-6a0baf0a585f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca32199-302c-4341-a409-3f98254e4181]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:09 user nova-compute[74839]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)
Nov 18 15:53:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130370e-c109-4310-912a-624c374b4dae]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snLCYZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:09 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Deleted allocations for instance 262be841-6b58-4075-832e-0e67a155c4aa
Nov 18 15:53:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-889c4039-16fc-48bf-9437-a89274597f5d tempest-TestStampPattern-1229984930 tempest-TestStampPattern-1229984930-project-member] Lock "262be841-6b58-4075-832e-0e67a155c4aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.004s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26237363236393936', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237363236393936', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] Acquiring lock "262be841-6b58-4075-832e-0e67a155c4aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] Lock "262be841-6b58-4075-832e-0e67a155c4aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] No waiting events found dispatching network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:10 user nova-compute[74839]: WARNING nova.compute.manager [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received unexpected event network-vif-plugged-9a620a55-1720-40be-a227-58e69797c8b4 for instance with vm_state deleted and task_state None.
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-c86ab4e7-c408-438d-91f2-368656bfd774 req-dda74a5d-2fa6-4a86-95cd-da39add34bd6 service nova] [instance: 262be841-6b58-4075-832e-0e67a155c4aa] Received event network-vif-deleted-9a620a55-1720-40be-a227-58e69797c8b4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:53:10 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:53:10 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:53:10 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:53:10 user nova-compute[74839]:   <serial>35e4a55a-a125-4b0a-965c-206f49d88585</serial>
Nov 18 15:53:10 user nova-compute[74839]: </disk>
Nov 18 15:53:10 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No VIF found with MAC fa:16:3e:1f:0b:7c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:53:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6fa71347-af2f-458a-9823-e3b9d6a006e3 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.852s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:23 user nova-compute[74839]: INFO nova.compute.manager [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Detaching volume 35e4a55a-a125-4b0a-965c-206f49d88585
Nov 18 15:53:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:23 user nova-compute[74839]: INFO nova.virt.block_device [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attempting to driver detach volume 35e4a55a-a125-4b0a-965c-206f49d88585 from mountpoint /dev/vdb
Nov 18 15:53:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Attempting to detach device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:53:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:53:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:53:23 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:53:23 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:53:23 user nova-compute[74839]:   <serial>35e4a55a-a125-4b0a-965c-206f49d88585</serial>
Nov 18 15:53:23 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:53:23 user nova-compute[74839]: </disk>
Nov 18 15:53:23 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:53:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config.
Nov 18 15:53:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:53:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:53:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:53:23 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:53:23 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:53:23 user nova-compute[74839]:   <serial>35e4a55a-a125-4b0a-965c-206f49d88585</serial>
Nov 18 15:53:23 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:53:23 user nova-compute[74839]: </disk>
Nov 18 15:53:23 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:53:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:53:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:53:38 user nova-compute[74839]: INFO nova.compute.claims [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Claim successful on node user
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:53:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.policy [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baefb1ed20034faa83b9872267e74460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7daccded38c4ddf9815114b16e9e798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:53:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Creating image(s)
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "/opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "/opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk 1073741824" returned: 0 in 0.055s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Successfully created port: f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Cannot resize image /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Ensure instance console log exists: /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Successfully updated port: f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquired lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-changed-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Refreshing instance network info cache due to event network-changed-f45f9ed0-9246-41da-bc3b-1667840ac327. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] Acquiring lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updating instance_info_cache with network_info: [{"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Releasing lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Instance network_info: |[{"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] Acquired lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.neutron [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Refreshing network info cache for port f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Start _get_guest_xml network_info=[{"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:53:40 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:40 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-247530748',display_name='tempest-VolumesSnapshotTestJSON-instance-247530748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-247530748',id=38,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn5eKqFlYF1bftmnQrVb6ud1r8C/3pYqQPkzL67l2boWzZ7ttHHnMEhh+fMYfVgHv9UPOWEzatlRLVXAxzWKuKMRYun5ODE6qVhFrxVdwmlZg/Omn4ZSQPXIPBlfHGOUA==',key_name='tempest-keypair-1043061308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-4kl4ci00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=7e3fe391-7d5f-40b0-900c-3c07f4fdd128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.objects.instance [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:53:40 user nova-compute[74839]:   <uuid>7e3fe391-7d5f-40b0-900c-3c07f4fdd128</uuid>
Nov 18 15:53:40 user nova-compute[74839]:   <name>instance-00000026</name>
Nov 18 15:53:40 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:53:40 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:53:40 user nova-compute[74839]:   <metadata>
Nov 18 15:53:40 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:53:40 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-247530748</nova:name>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:53:40</nova:creationTime>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:53:40 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:53:40 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:owner>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:user uuid="baefb1ed20034faa83b9872267e74460">tempest-VolumesSnapshotTestJSON-1293713294-project-member</nova:user>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:project uuid="e7daccded38c4ddf9815114b16e9e798">tempest-VolumesSnapshotTestJSON-1293713294</nova:project>
Nov 18 15:53:40 user nova-compute[74839]:       </nova:owner>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:53:40 user nova-compute[74839]:       <nova:ports>
Nov 18 15:53:40 user nova-compute[74839]:         <nova:port uuid="f45f9ed0-9246-41da-bc3b-1667840ac327">
Nov 18 15:53:40 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:53:40 user nova-compute[74839]:         </nova:port>
Nov 18 15:53:40 user nova-compute[74839]:       </nova:ports>
Nov 18 15:53:40 user nova-compute[74839]:     </nova:instance>
Nov 18 15:53:40 user nova-compute[74839]:   </metadata>
Nov 18 15:53:40 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:53:40 user nova-compute[74839]:     <system>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="serial">7e3fe391-7d5f-40b0-900c-3c07f4fdd128</entry>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="uuid">7e3fe391-7d5f-40b0-900c-3c07f4fdd128</entry>
Nov 18 15:53:40 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:53:40 user nova-compute[74839]:     </system>
Nov 18 15:53:40 user nova-compute[74839]:   </sysinfo>
Nov 18 15:53:40 user nova-compute[74839]:   <os>
Nov 18 15:53:40 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:53:40 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:53:40 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:53:40 user nova-compute[74839]:   </os>
Nov 18 15:53:40 user nova-compute[74839]:   <features>
Nov 18 15:53:40 user nova-compute[74839]:     <acpi/>
Nov 18 15:53:40 user nova-compute[74839]:     <apic/>
Nov 18 15:53:40 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:53:40 user nova-compute[74839]:   </features>
Nov 18 15:53:40 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:53:40 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:53:40 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:53:40 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:53:40 user nova-compute[74839]:   </clock>
Nov 18 15:53:40 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:53:40 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:53:40 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:53:40 user nova-compute[74839]:   </cpu>
Nov 18 15:53:40 user nova-compute[74839]:   <devices>
Nov 18 15:53:40 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:53:40 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:53:40 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk"/>
Nov 18 15:53:40 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:53:40 user nova-compute[74839]:     </disk>
Nov 18 15:53:40 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:53:40 user nova-compute[74839]:       <mac address="fa:16:3e:97:69:62"/>
Nov 18 15:53:40 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:53:40 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:53:40 user nova-compute[74839]:       <target dev="tapf45f9ed0-92"/>
Nov 18 15:53:40 user nova-compute[74839]:     </interface>
Nov 18 15:53:40 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:53:40 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/console.log" append="off"/>
Nov 18 15:53:40 user nova-compute[74839]:     </serial>
Nov 18 15:53:40 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:53:40 user nova-compute[74839]:     <video>
Nov 18 15:53:40 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:53:40 user nova-compute[74839]:     </video>
Nov 18 15:53:40 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:53:40 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:53:40 user nova-compute[74839]:     </rng>
Nov 18 15:53:40 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:53:40 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:53:40 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:53:40 user nova-compute[74839]:     </memballoon>
Nov 18 15:53:40 user nova-compute[74839]:   </devices>
Nov 18 15:53:40 user nova-compute[74839]: </domain>
Nov 18 15:53:40 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-247530748',display_name='tempest-VolumesSnapshotTestJSON-instance-247530748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-247530748',id=38,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn5eKqFlYF1bftmnQrVb6ud1r8C/3pYqQPkzL67l2boWzZ7ttHHnMEhh+fMYfVgHv9UPOWEzatlRLVXAxzWKuKMRYun5ODE6qVhFrxVdwmlZg/Omn4ZSQPXIPBlfHGOUA==',key_name='tempest-keypair-1043061308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-4kl4ci00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:53:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=7e3fe391-7d5f-40b0-900c-3c07f4fdd128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG os_vif [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '371eb9e5-f6ef-5ceb-992c-38e4b121591b', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf45f9ed0-92, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf45f9ed0-92, col_values=(('qos', UUID('8db4aaa4-2c40-4369-97bb-8789feed0da7')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf45f9ed0-92, col_values=(('external_ids', {'iface-id': 'f45f9ed0-9246-41da-bc3b-1667840ac327', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:69:62', 'vm-uuid': '7e3fe391-7d5f-40b0-900c-3c07f4fdd128'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: INFO os_vif [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92')
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No VIF found with MAC fa:16:3e:97:69:62, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.neutron [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updated VIF entry in instance network info cache for port f45f9ed0-9246-41da-bc3b-1667840ac327. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.network.neutron [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updating instance_info_cache with network_info: [{"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9eb259fa-98f8-46fa-ab3c-dc38b18917d0 req-61812713-7013-4da2-bbd6-2d3ce359b787 service nova] Releasing lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:40 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:53:40 user nova-compute[74839]: INFO nova.compute.claims [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Claim successful on node user
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:53:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.policy [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acb04bd192ff4c1b85dbe05b89802f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e183c20cc34ab0bd279ff421ab0b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:53:41 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Creating image(s)
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "/opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "/opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk 1073741824" returned: 0 in 0.055s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] No waiting events found dispatching network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:42 user nova-compute[74839]: WARNING nova.compute.manager [req-55891ab5-6a97-4571-8be9-4d2973abf346 req-43bbf166-8770-4209-ab16-f9d9a2707906 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received unexpected event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 for instance with vm_state building and task_state spawning.
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Successfully created port: 736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Cannot resize image /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Ensure instance console log exists: /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Successfully updated port: 736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquired lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Updating instance_info_cache with network_info: [{"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Releasing lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Instance network_info: |[{"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Start _get_guest_xml network_info=[{"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:53:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-405759449',display_name='tempest-VolumesActionsTest-instance-405759449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-405759449',id=39,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-88j9fb8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:53:41Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=5a71d968-cc6e-41f6-8771-f06181a2d198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.objects.instance [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a71d968-cc6e-41f6-8771-f06181a2d198 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd is timed out.
Nov 18 15:53:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config.
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snLCYZoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:53:43 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:53:43 user nova-compute[74839]:   <uuid>5a71d968-cc6e-41f6-8771-f06181a2d198</uuid>
Nov 18 15:53:43 user nova-compute[74839]:   <name>instance-00000027</name>
Nov 18 15:53:43 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:53:43 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:53:43 user nova-compute[74839]:   <metadata>
Nov 18 15:53:43 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:53:43 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:name>tempest-VolumesActionsTest-instance-405759449</nova:name>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:53:43</nova:creationTime>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:53:43 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:53:43 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:owner>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:user uuid="acb04bd192ff4c1b85dbe05b89802f7d">tempest-VolumesActionsTest-1666497097-project-member</nova:user>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:project uuid="28e183c20cc34ab0bd279ff421ab0b1b">tempest-VolumesActionsTest-1666497097</nova:project>
Nov 18 15:53:43 user nova-compute[74839]:       </nova:owner>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:53:43 user nova-compute[74839]:       <nova:ports>
Nov 18 15:53:43 user nova-compute[74839]:         <nova:port uuid="736710ad-0674-468b-8895-f0e457a6c1cd">
Nov 18 15:53:43 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 15:53:43 user nova-compute[74839]:         </nova:port>
Nov 18 15:53:43 user nova-compute[74839]:       </nova:ports>
Nov 18 15:53:43 user nova-compute[74839]:     </nova:instance>
Nov 18 15:53:43 user nova-compute[74839]:   </metadata>
Nov 18 15:53:43 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:53:43 user nova-compute[74839]:     <system>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="serial">5a71d968-cc6e-41f6-8771-f06181a2d198</entry>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="uuid">5a71d968-cc6e-41f6-8771-f06181a2d198</entry>
Nov 18 15:53:43 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:53:43 user nova-compute[74839]:     </system>
Nov 18 15:53:43 user nova-compute[74839]:   </sysinfo>
Nov 18 15:53:43 user nova-compute[74839]:   <os>
Nov 18 15:53:43 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:53:43 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:53:43 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:53:43 user nova-compute[74839]:   </os>
Nov 18 15:53:43 user nova-compute[74839]:   <features>
Nov 18 15:53:43 user nova-compute[74839]:     <acpi/>
Nov 18 15:53:43 user nova-compute[74839]:     <apic/>
Nov 18 15:53:43 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:53:43 user nova-compute[74839]:   </features>
Nov 18 15:53:43 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:53:43 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:53:43 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:53:43 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:53:43 user nova-compute[74839]:   </clock>
Nov 18 15:53:43 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:53:43 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:53:43 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:53:43 user nova-compute[74839]:   </cpu>
Nov 18 15:53:43 user nova-compute[74839]:   <devices>
Nov 18 15:53:43 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:53:43 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:53:43 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk"/>
Nov 18 15:53:43 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:53:43 user nova-compute[74839]:     </disk>
Nov 18 15:53:43 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:53:43 user nova-compute[74839]:       <mac address="fa:16:3e:3b:39:de"/>
Nov 18 15:53:43 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:53:43 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:53:43 user nova-compute[74839]:       <target dev="tap736710ad-06"/>
Nov 18 15:53:43 user nova-compute[74839]:     </interface>
Nov 18 15:53:43 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:53:43 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/console.log" append="off"/>
Nov 18 15:53:43 user nova-compute[74839]:     </serial>
Nov 18 15:53:43 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:53:43 user nova-compute[74839]:     <video>
Nov 18 15:53:43 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:53:43 user nova-compute[74839]:     </video>
Nov 18 15:53:43 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:53:43 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:53:43 user nova-compute[74839]:     </rng>
Nov 18 15:53:43 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:53:43 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:53:43 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:53:43 user nova-compute[74839]:     </memballoon>
Nov 18 15:53:43 user nova-compute[74839]:   </devices>
Nov 18 15:53:43 user nova-compute[74839]: </domain>
Nov 18 15:53:43 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-405759449',display_name='tempest-VolumesActionsTest-instance-405759449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-405759449',id=39,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-88j9fb8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:53:41Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=5a71d968-cc6e-41f6-8771-f06181a2d198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_vif [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c50daa7-bc1b-5bff-a0f4-dad1e8fb2765', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe0721f-396a-42fd-a3ac-23b33c7ecb96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:53:43 user nova-compute[74839]: No targets found.
Nov 18 15:53:43 user nova-compute[74839]: iSNS:
Nov 18 15:53:43 user nova-compute[74839]: No targets found.
Nov 18 15:53:43 user nova-compute[74839]: STATIC:
Nov 18 15:53:43 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:53:43 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:53:43 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:53:43 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585
Nov 18 15:53:43 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:53:43 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:53:43 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:53:43 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:53:43 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:53:43 user nova-compute[74839]: FIRMWARE:
Nov 18 15:53:43 user nova-compute[74839]: No targets found.
Nov 18 15:53:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:53:43 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:53:43 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap736710ad-06, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap736710ad-06, col_values=(('qos', UUID('653c005a-6f0c-47dd-a269-007303f49613')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap736710ad-06, col_values=(('external_ids', {'iface-id': '736710ad-0674-468b-8895-f0e457a6c1cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:39:de', 'vm-uuid': '5a71d968-cc6e-41f6-8771-f06181a2d198'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:44 user nova-compute[74839]: INFO os_vif [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06')
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934d08a-0d84-47c1-b0a0-f473627ef310]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1283579-bbf5-4268-9f42-f4d1ba99cee7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:44 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:44 user nova-compute[74839]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)
Nov 18 15:53:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:53:44 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:53:44 user nova-compute[74839]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 (non-flash)
Nov 18 15:53:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801ce7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9516a48-9b85-4747-aaad-1a244c1e61f7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] No VIF found with MAC fa:16:3e:3b:39:de, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[16981eda-3d15-4915-aea7-429f8665f754]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e198c3e-e54c-45e4-a0e6-e39293e0b444]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e8eca-7bf6-40e7-b058-200fb02430ec]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3e6919-ce92-4595-b700-e5617062a5f4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] No waiting events found dispatching network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:44 user nova-compute[74839]: WARNING nova.compute.manager [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received unexpected event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 for instance with vm_state building and task_state spawning.
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-changed-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Refreshing instance network info cache due to event network-changed-736710ad-0674-468b-8895-f0e457a6c1cd. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Acquiring lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Acquired lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Refreshing network info cache for port 736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:53:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Instance spawned successfully.
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8d596-c443-4ee4-83f9-c20ba062cd70]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260]
Nov 18 15:53:44 user nova-compute[74839]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585, portal: 172.16.0.220,3260] successful.
Nov 18 15:53:44 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35e4a55a-a125-4b0a-965c-206f49d88585 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607e4c3-6cf1-4bb9-9ddc-9ce880c28d7f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== disconnect_volume: return (386ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:53:44 user nova-compute[74839]: INFO nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:53:44 user nova-compute[74839]: INFO nova.compute.manager [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Took 6.54 seconds to build instance.
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-3757564a-4834-4acc-8b6a-170bbc10eb7f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.646s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Updated VIF entry in instance network info cache for port 736710ad-0674-468b-8895-f0e457a6c1cd. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Updating instance_info_cache with network_info: [{"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f94c4c3f-f222-4cad-b1bb-94a19b96d320 req-dc180aae-7fa5-4b84-8fa8-7981a2e423c4 service nova] Releasing lock "refresh_cache-5a71d968-cc6e-41f6-8771-f06181a2d198" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0b9bcb65-07fc-4c66-8ab0-8d7bfb4f610f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:45 user nova-compute[74839]: DEBUG nova.compute.manager [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] No waiting events found dispatching network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:45 user nova-compute[74839]: WARNING nova.compute.manager [req-22930fb0-f987-4c37-bf5a-124666f03427 req-f4a45a02-4848-4f17-bb2c-10beed645a05 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received unexpected event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd for instance with vm_state building and task_state spawning.
Nov 18 15:53:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:53:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Instance spawned successfully.
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] No waiting events found dispatching network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:53:47 user nova-compute[74839]: WARNING nova.compute.manager [req-b83a4eda-d806-459d-b8cd-0de40b113633 req-78659b16-42a1-4f97-a371-9dbc7a7c3402 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received unexpected event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd for instance with vm_state building and task_state spawning.
Nov 18 15:53:47 user nova-compute[74839]: INFO nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 18 15:53:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:53:47 user nova-compute[74839]: INFO nova.compute.manager [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Took 6.86 seconds to build instance.
Nov 18 15:53:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88e00f27-edae-41fb-b6d3-af14b1e5bc20 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:49 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:49 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:49 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updating instance_info_cache with network_info: [{"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-52e37fef-6ad5-49c9-a334-d40249b06ea3" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:53:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:53 user nova-compute[74839]: INFO nova.compute.manager [None req-86addef6-df00-4936-9e11-e1bbc1cb16ec tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Get console output
Nov 18 15:53:53 user nova-compute[74839]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 18 15:53:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:53:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:53:54 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:53:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:53:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:53:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7867MB free_disk=25.23963165283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 31053684-0b7e-476a-ad00-75855f339d6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 5a71d968-cc6e-41f6-8771-f06181a2d198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:53:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-changed-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing instance network info cache due to event network-changed-25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG nova.network.neutron [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:11 user nova-compute[74839]: INFO nova.compute.manager [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Detaching volume 1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:54:11 user nova-compute[74839]: INFO nova.virt.block_device [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Attempting to driver detach volume 1bb05510-c268-4bdb-b2fa-3b16c2e6603b from mountpoint /dev/vdb
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Attempting to detach device vdb from instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:54:11 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:54:11 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:54:11 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:54:11 user nova-compute[74839]:   <serial>1bb05510-c268-4bdb-b2fa-3b16c2e6603b</serial>
Nov 18 15:54:11 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:54:11 user nova-compute[74839]: </disk>
Nov 18 15:54:11 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:54:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully detached device vdb from instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd from the persistent domain config.
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:54:11 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:54:11 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:54:11 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:54:11 user nova-compute[74839]:   <serial>1bb05510-c268-4bdb-b2fa-3b16c2e6603b</serial>
Nov 18 15:54:11 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:54:11 user nova-compute[74839]: </disk>
Nov 18 15:54:11 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updated VIF entry in instance network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc9c851f-7690-4721-8aeb-a2c3b2d2e061 req-cd656a14-3b33-4585-892b-ad81d1578912 service nova] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:54:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:54:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-changed-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:54:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing instance network info cache due to event network-changed-25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:54:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] Acquiring lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:54:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] Acquired lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:54:12 user nova-compute[74839]: DEBUG nova.network.neutron [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Refreshing network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:54:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updated VIF entry in instance network info cache for port 25445020-24b6-4503-87c6-a9e6749d687d. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:54:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [{"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:54:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-345df02a-9121-498c-bcbf-93ab726af0ac req-1f37ef0e-055e-4640-9e04-a14ccb3edfbd service nova] Releasing lock "refresh_cache-48b20f53-d048-4da5-8e93-9b22a4b20fbd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:54:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:16 user nova-compute[74839]: INFO nova.compute.manager [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attaching volume e763cae3-8a83-4763-8fb7-312b873defb6 to /dev/vdb
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.utils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5167c0f7-ba51-4236-a200-ac55ce80c6cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[340cb846-4395-4dc8-b521-9dc43dbe4b23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd6d84f-56ba-43a6-a744-6ca3b26f5499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1c68a-9aca-4ecd-9022-aad6cee0efec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:54:16 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:54:16 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c304b2b-8254-4072-a759-822ab3d06894]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG os_brick.utils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:54:16 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating existing volume attachment record: 98060282-2a87-4770-950d-c7c66362025f {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:54:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:54:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBqkvxJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:54:21 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:54:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:54:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:54:21 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:54:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:54:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:54:21 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:54:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d94169c-f46f-419c-aaae-12bbc795a797]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:54:22 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c441a-36f9-4f29-9833-44f309cff25f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6] added
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[98522144-0622-449c-9d96-2c7b8608e39e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f84593-8b4c-4bf2-a99a-19015d32c86e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBqkvxJe {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rBqkvxJe" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fda44f-77da-4cec-bd3e-7d63c6435023]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rBqkvxJe'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f179898-f861-4388-98bf-e87e0ac0cc78]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b004e-b391-4936-ab74-90e853a8f634]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594970e-9dc8-4d5f-a0d0-288a94d8a6e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260]
Nov 18 15:54:22 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260] successful.
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2844e69-b1f8-4eb4-8d40-dbd4a5573e38]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b1655-b893-4735-a478-7087c31b5eb2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:22 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:22 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d0d1f-0054-46c7-bfe8-b077420a4ad7]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:54:22 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBqkvxJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23761396130316262', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761396130316262', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:54:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:54:23 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:54:23 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:54:23 user nova-compute[74839]:   <serial>e763cae3-8a83-4763-8fb7-312b873defb6</serial>
Nov 18 15:54:23 user nova-compute[74839]: </disk>
Nov 18 15:54:23 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:54:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No VIF found with MAC fa:16:3e:1f:0b:7c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:54:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d57ea0dd-310f-406e-882c-9722ea427b9f tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.458s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:25 user nova-compute[74839]: INFO nova.compute.manager [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Detaching volume e763cae3-8a83-4763-8fb7-312b873defb6
Nov 18 15:54:25 user nova-compute[74839]: INFO nova.virt.block_device [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attempting to driver detach volume e763cae3-8a83-4763-8fb7-312b873defb6 from mountpoint /dev/vdb
Nov 18 15:54:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Attempting to detach device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:54:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:54:25 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:54:25 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:54:25 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:54:25 user nova-compute[74839]:   <serial>e763cae3-8a83-4763-8fb7-312b873defb6</serial>
Nov 18 15:54:25 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:54:25 user nova-compute[74839]: </disk>
Nov 18 15:54:25 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:54:25 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config.
Nov 18 15:54:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:54:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:54:25 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:54:25 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 15:54:25 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:54:25 user nova-compute[74839]:   <serial>e763cae3-8a83-4763-8fb7-312b873defb6</serial>
Nov 18 15:54:25 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:54:25 user nova-compute[74839]: </disk>
Nov 18 15:54:25 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:54:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:54:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:31 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd is timed out.
Nov 18 15:54:31 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully detached device vdb from instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd from the live domain config.
Nov 18 15:54:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONrmIpuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:54:31 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd07ea0-506f-42b5-9a3a-aee6efc4ab65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:54:31 user nova-compute[74839]: No targets found.
Nov 18 15:54:31 user nova-compute[74839]: iSNS:
Nov 18 15:54:31 user nova-compute[74839]: No targets found.
Nov 18 15:54:31 user nova-compute[74839]: STATIC:
Nov 18 15:54:31 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6
Nov 18 15:54:31 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:31 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:31 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b
Nov 18 15:54:31 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:31 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:31 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:54:31 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:31 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:31 user nova-compute[74839]: FIRMWARE:
Nov 18 15:54:31 user nova-compute[74839]: No targets found.
Nov 18 15:54:31 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:54:31 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:54:31 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd8528-f433-4148-8783-a3d94fcc9562]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254fcd3-d333-4dd1-b228-f517b35872da]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:31 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:31 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:31 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:31 user nova-compute[74839]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b (non-flash)
Nov 18 15:54:31 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:31 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4803efe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c336651-63b9-4e55-84d6-f73cb190c896]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8b20b8-a8ba-42da-88be-3ed3e740b38c]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db27e7bf-99f9-488b-ad25-8cfad67890bd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a6cd5-9ca4-4ba4-891b-b9897fb81768]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f6d9f-dde5-4a61-9f3c-99176d81a1bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[530af6aa-e259-4c5b-a27d-8ae338687d34]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260]
Nov 18 15:54:31 user nova-compute[74839]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b, portal: 172.16.0.220,3260] successful.
Nov 18 15:54:31 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bb05510-c268-4bdb-b2fa-3b16c2e6603b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[074cc053-2aac-46a7-a2e4-e7c2958955fc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] <== disconnect_volume: return (287ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:54:31 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:54:32 user nova-compute[74839]: DEBUG nova.objects.instance [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'flavor' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:54:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-aece122e-cde5-4f11-84ee-d1fe93174245 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.578s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:54:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:54:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:46 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd is timed out.
Nov 18 15:54:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config.
Nov 18 15:54:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rBqkvxJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:54:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[628dd8b2-19e3-4870-9147-ebf2ff03f999]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:54:46 user nova-compute[74839]: No targets found.
Nov 18 15:54:46 user nova-compute[74839]: iSNS:
Nov 18 15:54:46 user nova-compute[74839]: No targets found.
Nov 18 15:54:46 user nova-compute[74839]: STATIC:
Nov 18 15:54:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6
Nov 18 15:54:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:46 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:54:46 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:46 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:46 user nova-compute[74839]: FIRMWARE:
Nov 18 15:54:46 user nova-compute[74839]: No targets found.
Nov 18 15:54:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:54:46 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:54:46 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29045b-6757-4be8-9ea6-da80aee5df64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e31c47d-499d-40cd-a2ab-c800dca8d6e1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:46 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:46 user nova-compute[74839]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 (non-flash)
Nov 18 15:54:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55906fb-c727-4daa-ad11-67f540bcc5b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc033e-2f65-42fb-8868-23ce3171bcb3]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d9038-13cd-437e-b16f-9bd9b8f856f3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5bb56d-9ced-4ec5-bfe3-887c1078397c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e33797-864d-45f6-b7d3-86cecfa4ded4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b63a2-9aa9-462e-b332-cf2a53b9253d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260]
Nov 18 15:54:46 user nova-compute[74839]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6, portal: 172.16.0.220,3260] successful.
Nov 18 15:54:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e763cae3-8a83-4763-8fb7-312b873defb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839e738-62b7-47f3-ad11-2d5fedce91d7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== disconnect_volume: return (272ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:54:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:54:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:54:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9ee5e456-e75d-4c73-b220-f5b9aa440c93 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.565s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [{"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-31053684-0b7e-476a-ad00-75855f339d6e" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:54:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:53 user nova-compute[74839]: INFO nova.compute.manager [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Terminating instance
Nov 18 15:54:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-059387a9-78b1-4138-b0d1-79eb178c9caf req-0debddec-3b62-44f4-a317-96969cf26bfd service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-unplugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Instance destroyed successfully.
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'resources' on Instance uuid 31053684-0b7e-476a-ad00-75855f339d6e {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-207187813',display_name='tempest-ServerActionsTestOtherA-server-207187813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-207187813',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-sd0z59cm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=31053684-0b7e-476a-ad00-75855f339d6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "address": "fa:16:3e:5e:1a:ab", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d85a813-fe", "ovs_interfaceid": "4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_vif [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d85a813-fe, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=966236e1-1c39-428f-a51a-a41be0290bb5) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:54:54 user nova-compute[74839]: INFO os_vif [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1a:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d85a813-fe')
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvTxnOdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:54:54 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f85a95-1393-421e-b0ad-773b4fcf0f16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:54:54 user nova-compute[74839]: No targets found.
Nov 18 15:54:54 user nova-compute[74839]: iSNS:
Nov 18 15:54:54 user nova-compute[74839]: No targets found.
Nov 18 15:54:54 user nova-compute[74839]: STATIC:
Nov 18 15:54:54 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e
Nov 18 15:54:54 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:54:54 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:54:54 user nova-compute[74839]: FIRMWARE:
Nov 18 15:54:54 user nova-compute[74839]: No targets found.
Nov 18 15:54:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:54:54 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:54:54 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f9373-fce1-4955-9010-cd0b372d0871]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ff43a7-1e41-4a73-a6b3-066cf099b76d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e (non-flash)
Nov 18 15:54:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48064c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd500b-9b2e-4cdb-b52e-5a58e638b21b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a26ca1-e6ad-4a66-90f8-2f7571caa4f8]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405dcd1-7c35-45d2-9973-d690a4e732c5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b55256-417b-4354-ab0c-7f8134071aec]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.085s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a8bb3-3ad7-480a-b58b-5fbb4da9ccc8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8934e983-ce3f-4c89-83ea-7743a1f45695]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260]
Nov 18 15:54:54 user nova-compute[74839]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e, portal: 172.16.0.220,3260] successful.
Nov 18 15:54:54 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387a368-a8ff-409b-9731-ab29d3d6861e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8caccf-50d9-4910-814c-db8d001ed045]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] <== disconnect_volume: return (332ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:54:55 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Deleting instance files /opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e_del
Nov 18 15:54:55 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Deletion of /opt/stack/data/nova/instances/31053684-0b7e-476a-ad00-75855f339d6e_del complete
Nov 18 15:54:55 user nova-compute[74839]: INFO nova.compute.manager [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:54:55 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Took 0.70 seconds to deallocate network for instance.
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-f69947c1-b6f6-40fd-87d6-20ed388bd095 req-fbb9048d-1693-40f4-bf40-226065544834 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-deleted-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:54:55 user nova-compute[74839]: INFO nova.compute.manager [req-f69947c1-b6f6-40fd-87d6-20ed388bd095 req-fbb9048d-1693-40f4-bf40-226065544834 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Neutron deleted interface 4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4; detaching it from the instance and deleting it from the info cache
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-f69947c1-b6f6-40fd-87d6-20ed388bd095 req-fbb9048d-1693-40f4-bf40-226065544834 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-f69947c1-b6f6-40fd-87d6-20ed388bd095 req-fbb9048d-1693-40f4-bf40-226065544834 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Detach interface failed, port_id=4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4, reason: Instance 31053684-0b7e-476a-ad00-75855f339d6e could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] Acquiring lock "31053684-0b7e-476a-ad00-75855f339d6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] Lock "31053684-0b7e-476a-ad00-75855f339d6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] No waiting events found dispatching network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:54:56 user nova-compute[74839]: WARNING nova.compute.manager [req-23ca2f02-6d95-4738-93dc-4d32fede3bcc req-62e7ca8d-5711-44af-9be1-b9e4b6a09d26 service nova] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Received unexpected event network-vif-plugged-4d85a813-fefc-4dc1-b0eb-ea8e650a5ed4 for instance with vm_state active and task_state deleting.
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:56 user nova-compute[74839]: INFO nova.compute.manager [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Took 0.73 seconds to detach 1 volumes for instance.
Nov 18 15:54:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: 31053684-0b7e-476a-ad00-75855f339d6e] Deleting volume: c387a368-a8ff-409b-9731-ab29d3d6861e {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:57 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Deleted allocations for instance 31053684-0b7e-476a-ad00-75855f339d6e
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-4143fa09-4bd4-43d0-8bc4-38194f6a2ad6 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "31053684-0b7e-476a-ad00-75855f339d6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.382s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:54:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:54:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:54:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=25.174209594726562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:54:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance df4b8778-e410-4771-99f8-eefb3aeb39d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 5a71d968-cc6e-41f6-8771-f06181a2d198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:55:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:01 user nova-compute[74839]: INFO nova.compute.manager [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Terminating instance
Nov 18 15:55:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-4201da86-1d7e-4340-80c0-4c5debd48f98 req-3f2379ba-9376-48bd-ab00-26cbcd2c8ac2 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-unplugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Instance destroyed successfully.
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid 48b20f53-d048-4da5-8e93-9b22a4b20fbd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1808538275',display_name='tempest-ServerRescueNegativeTestJSON-server-1808538275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1808538275',id=34,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICyu6/r9l+ppTsIuzWariAwtkTOhPgx/DWIN5iRu38XE5mcH4Hq1n6kgGxZ1ud7VZZ5CDWPGZ5IwOgRTG6UdvR5TRHTZDbSpt6g+pXLcuVyTNrFZJXBikL96eCInmLanA==',key_name='tempest-keypair-896753568',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-69309dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:52:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=48b20f53-d048-4da5-8e93-9b22a4b20fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "25445020-24b6-4503-87c6-a9e6749d687d", "address": "fa:16:3e:31:2b:cb", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25445020-24", "ovs_interfaceid": "25445020-24b6-4503-87c6-a9e6749d687d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG os_vif [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25445020-24, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=248f28ae-5eab-4946-8fd6-9f7bc6714ec4) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:02 user nova-compute[74839]: INFO os_vif [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:2b:cb,bridge_name='br-int',has_traffic_filtering=True,id=25445020-24b6-4503-87c6-a9e6749d687d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25445020-24')
Nov 18 15:55:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Deleting instance files /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd_del
Nov 18 15:55:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Deletion of /opt/stack/data/nova/instances/48b20f53-d048-4da5-8e93-9b22a4b20fbd_del complete
Nov 18 15:55:02 user nova-compute[74839]: INFO nova.compute.manager [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 18 15:55:02 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:03 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Took 0.76 seconds to deallocate network for instance.
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-e06cda7c-69fb-4f88-ae11-8ce8dea472ac req-178c8edc-eb97-4ded-b0e8-5fd4846b4e3d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-deleted-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:03 user nova-compute[74839]: INFO nova.compute.manager [req-e06cda7c-69fb-4f88-ae11-8ce8dea472ac req-178c8edc-eb97-4ded-b0e8-5fd4846b4e3d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Neutron deleted interface 25445020-24b6-4503-87c6-a9e6749d687d; detaching it from the instance and deleting it from the info cache
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.network.neutron [req-e06cda7c-69fb-4f88-ae11-8ce8dea472ac req-178c8edc-eb97-4ded-b0e8-5fd4846b4e3d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-e06cda7c-69fb-4f88-ae11-8ce8dea472ac req-178c8edc-eb97-4ded-b0e8-5fd4846b4e3d service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Detach interface failed, port_id=25445020-24b6-4503-87c6-a9e6749d687d, reason: Instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:03 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Deleted allocations for instance 48b20f53-d048-4da5-8e93-9b22a4b20fbd
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-269760d5-5e03-4a06-b5ef-14fda38ae205 tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] Acquiring lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] Lock "48b20f53-d048-4da5-8e93-9b22a4b20fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] No waiting events found dispatching network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:03 user nova-compute[74839]: WARNING nova.compute.manager [req-d6c4bfd8-84de-4d4d-b3ba-cc841d5ca149 req-50d48518-525d-405d-99c8-48171221d6d5 service nova] [instance: 48b20f53-d048-4da5-8e93-9b22a4b20fbd] Received unexpected event network-vif-plugged-25445020-24b6-4503-87c6-a9e6749d687d for instance with vm_state deleted and task_state None.
Nov 18 15:55:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:06 user nova-compute[74839]: INFO nova.compute.manager [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Terminating instance
Nov 18 15:55:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-unplugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] No waiting events found dispatching network-vif-unplugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-ce140299-51f8-4312-809f-aa8f150bab71 req-26ffaa05-c3a1-468f-aaa0-f94719dca1e5 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-unplugged-24e48126-6867-443d-8420-f63dfe60f569 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Instance destroyed successfully.
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lazy-loading 'resources' on Instance uuid 52e37fef-6ad5-49c9-a334-d40249b06ea3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-692908807',display_name='tempest-ServersNegativeTestJSON-server-692908807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-692908807',id=31,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f77dd3e39e4b66acc27cd4aa4d78fe',ramdisk_id='',reservation_id='r-uzyytpp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1785706841',owner_user_name='tempest-ServersNegativeTestJSON-1785706841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:46:30Z,user_data=None,user_id='7e7d7f55ded140ee834ec8f4126c27a1',uuid=52e37fef-6ad5-49c9-a334-d40249b06ea3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converting VIF {"id": "24e48126-6867-443d-8420-f63dfe60f569", "address": "fa:16:3e:8f:26:f7", "network": {"id": "ecf206a9-500a-486d-a48e-2d109a073dd6", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1086022990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f77dd3e39e4b66acc27cd4aa4d78fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e48126-68", "ovs_interfaceid": "24e48126-6867-443d-8420-f63dfe60f569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG os_vif [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e48126-68, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad61c9ed-3c02-4b13-a1e9-af2c9f81a6b2) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:07 user nova-compute[74839]: INFO os_vif [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:26:f7,bridge_name='br-int',has_traffic_filtering=True,id=24e48126-6867-443d-8420-f63dfe60f569,network=Network(ecf206a9-500a-486d-a48e-2d109a073dd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e48126-68')
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Deleting instance files /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3_del
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Deletion of /opt/stack/data/nova/instances/52e37fef-6ad5-49c9-a334-d40249b06ea3_del complete
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.compute.manager [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 18 15:55:07 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Took 0.41 seconds to deallocate network for instance.
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-152d1006-31a7-4858-adfe-f88c857cb970 req-41e47dc3-bf57-43cf-bc5e-600b755a2586 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-deleted-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:07 user nova-compute[74839]: INFO nova.compute.manager [req-152d1006-31a7-4858-adfe-f88c857cb970 req-41e47dc3-bf57-43cf-bc5e-600b755a2586 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Neutron deleted interface 24e48126-6867-443d-8420-f63dfe60f569; detaching it from the instance and deleting it from the info cache
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-152d1006-31a7-4858-adfe-f88c857cb970 req-41e47dc3-bf57-43cf-bc5e-600b755a2586 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-152d1006-31a7-4858-adfe-f88c857cb970 req-41e47dc3-bf57-43cf-bc5e-600b755a2586 service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Detach interface failed, port_id=24e48126-6867-443d-8420-f63dfe60f569, reason: Instance 52e37fef-6ad5-49c9-a334-d40249b06ea3 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:55:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:08 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:08 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:08 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Deleted allocations for instance 52e37fef-6ad5-49c9-a334-d40249b06ea3
Nov 18 15:55:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ea2ba4eb-0d15-4a7d-a235-00d05ac81ee6 tempest-ServersNegativeTestJSON-1785706841 tempest-ServersNegativeTestJSON-1785706841-project-member] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.514s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] Acquiring lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] Lock "52e37fef-6ad5-49c9-a334-d40249b06ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] No waiting events found dispatching network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:09 user nova-compute[74839]: WARNING nova.compute.manager [req-a9bbbfb2-a39c-4ffe-9c4d-f22698a84f96 req-19a3b9a0-a154-455d-96c2-83afc338762d service nova] [instance: 52e37fef-6ad5-49c9-a334-d40249b06ea3] Received unexpected event network-vif-plugged-24e48126-6867-443d-8420-f63dfe60f569 for instance with vm_state deleted and task_state None.
Nov 18 15:55:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:17 user nova-compute[74839]: INFO nova.compute.manager [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attaching volume 5ef6acdf-6758-4944-a598-c7c231c738b7 to /dev/vdb
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.utils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69a549-2a6c-4e36-bb14-9d7a8b5ad435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897e2a6-3069-42a8-aa0c-9e0b92bd4c12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc458288-5145-41cf-9155-3c87b4737bde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa04b28-060d-4cb6-ae16-3fb12aba5242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:55:18 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:55:18 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db91ec3-dc9f-48e9-b331-9114048a2258]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG os_brick.utils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:55:18 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating existing volume attachment record: 871d6d47-a8ca-40e7-bdd3-d09669ea2456 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:55:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFqdtUYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:55:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:55:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:55:23 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[310dd3d6-f754-4d1a-8bf1-dff6e459deb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:55:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be5df8-9732-4e6a-a0da-48c7828973cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7] added
Nov 18 15:55:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c10e64-cccb-429f-bc2f-aee6276dfc3b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c637a8-1470-4fe6-8b59-9020b55a4dc3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFqdtUYO {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFqdtUYO" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851ca26-c664-461d-830d-aea64c6637e0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFqdtUYO'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e552e-75e3-4d11-954a-3be92ca4e069]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9469fdc-f8ba-48b2-897d-17c93e088cf4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:55:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:55:23 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:55:23 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:55:23 user nova-compute[74839]: 
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eba458-5a06-4eeb-89de-c67bb0b9f086]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260]
Nov 18 15:55:23 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260] successful.
Nov 18 15:55:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc3d93-86c3-443a-8eea-111c97006810]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abc727b-85c9-44dc-bd9b-977b8fa17ad6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:23 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da2ea7e-91b8-4a65-8dbf-dcd418f3b147]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:55:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFqdtUYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:55:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:55:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23438653331666535', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:55:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438653331666535', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:55:24 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:55:24 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:24 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:55:24 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:24 user nova-compute[74839]:   <serial>5ef6acdf-6758-4944-a598-c7c231c738b7</serial>
Nov 18 15:55:24 user nova-compute[74839]: </disk>
Nov 18 15:55:24 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:55:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:55:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:55:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No VIF found with MAC fa:16:3e:1f:0b:7c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:55:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ef0a3799-184a-4744-aa5f-30e2559bafd4 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.260s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:27 user nova-compute[74839]: INFO nova.compute.manager [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Detaching volume 5ef6acdf-6758-4944-a598-c7c231c738b7
Nov 18 15:55:27 user nova-compute[74839]: INFO nova.virt.block_device [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attempting to driver detach volume 5ef6acdf-6758-4944-a598-c7c231c738b7 from mountpoint /dev/vdb
Nov 18 15:55:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Attempting to detach device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:55:27 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:27 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:55:27 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:27 user nova-compute[74839]:   <serial>5ef6acdf-6758-4944-a598-c7c231c738b7</serial>
Nov 18 15:55:27 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:55:27 user nova-compute[74839]: </disk>
Nov 18 15:55:27 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:55:27 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config.
Nov 18 15:55:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:55:27 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:27 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:55:27 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:27 user nova-compute[74839]:   <serial>5ef6acdf-6758-4944-a598-c7c231c738b7</serial>
Nov 18 15:55:27 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:55:27 user nova-compute[74839]: </disk>
Nov 18 15:55:27 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:55:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-changed-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Refreshing instance network info cache due to event network-changed-f45f9ed0-9246-41da-bc3b-1667840ac327. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:55:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] Acquiring lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:55:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] Acquired lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:55:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Refreshing network info cache for port f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updated VIF entry in instance network info cache for port f45f9ed0-9246-41da-bc3b-1667840ac327. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updating instance_info_cache with network_info: [{"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb6eac78-d598-4125-a8e2-639c01d118c8 req-99742507-fcb5-47e4-b593-b5d6d75e79e2 service nova] Releasing lock "refresh_cache-7e3fe391-7d5f-40b0-900c-3c07f4fdd128" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Ignoring supplied device name: /dev/vdb
Nov 18 15:55:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:30 user nova-compute[74839]: INFO nova.compute.manager [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Attaching volume 28b7ac32-fde9-4f10-acfc-df4c021102d6 to /dev/vdb
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d3c79-f038-417d-ba01-4530b3d409a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c3114f-5f0d-4ae4-b3c1-f19070a248c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ea5784-d799-4147-9e23-f536a58401cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b31e36-12ad-40a7-bfc9-f409238836a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:55:30 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:55:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8193db7-78de-486f-b1fb-193d500f2c8e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updating existing volume attachment record: 5f8ccec5-a9a6-42a3-a13b-3286f283a159 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:55:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:31 user nova-compute[74839]: INFO nova.compute.manager [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Terminating instance
Nov 18 15:55:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-unplugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] No waiting events found dispatching network-vif-unplugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-d1142d44-c76f-4d52-85ba-6cb21a7a8541 req-0bc3a32a-ea1c-4f52-ab50-0b2511857014 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-unplugged-736710ad-0674-468b-8895-f0e457a6c1cd for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Instance destroyed successfully.
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.objects.instance [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lazy-loading 'resources' on Instance uuid 5a71d968-cc6e-41f6-8771-f06181a2d198 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-405759449',display_name='tempest-VolumesActionsTest-instance-405759449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-405759449',id=39,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-88j9fb8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:53:48Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=5a71d968-cc6e-41f6-8771-f06181a2d198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "736710ad-0674-468b-8895-f0e457a6c1cd", "address": "fa:16:3e:3b:39:de", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap736710ad-06", "ovs_interfaceid": "736710ad-0674-468b-8895-f0e457a6c1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG os_vif [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap736710ad-06, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=653c005a-6f0c-47dd-a269-007303f49613) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:32 user nova-compute[74839]: INFO os_vif [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:39:de,bridge_name='br-int',has_traffic_filtering=True,id=736710ad-0674-468b-8895-f0e457a6c1cd,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap736710ad-06')
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Deleting instance files /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198_del
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Deletion of /opt/stack/data/nova/instances/5a71d968-cc6e-41f6-8771-f06181a2d198_del complete
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.compute.manager [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 18 15:55:32 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Took 0.43 seconds to deallocate network for instance.
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-2daf4b59-8566-4087-8be7-215c60f3de90 req-31c3fe6e-8e60-4788-b085-c9fd54e5f0b6 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-deleted-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:32 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Deleted allocations for instance 5a71d968-cc6e-41f6-8771-f06181a2d198
Nov 18 15:55:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-a841935d-e7e1-48da-b35d-442d6cbbbc42 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.687s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] Acquiring lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] Lock "5a71d968-cc6e-41f6-8771-f06181a2d198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] No waiting events found dispatching network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:33 user nova-compute[74839]: WARNING nova.compute.manager [req-544865d1-0f1f-4014-9fa2-9175ef9cb28a req-99c180db-c717-4766-b663-30484005dbf7 service nova] [instance: 5a71d968-cc6e-41f6-8771-f06181a2d198] Received unexpected event network-vif-plugged-736710ad-0674-468b-8895-f0e457a6c1cd for instance with vm_state deleted and task_state None.
Nov 18 15:55:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDxKsGSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:55:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:55:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:55:35 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ce75b-0e70-4853-83b2-e87e703669e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:55:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c7ba0-17d1-4d9c-9f0b-709c303bae7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6] added
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db8778e-58c6-497d-a4c8-64692d3bccfa]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb975e-7721-4e07-9d7c-d2ae5d47816f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDxKsGSV {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDxKsGSV" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff11aab2-bc10-483a-97aa-d0fc668785ae]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDxKsGSV'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41bdaff-6c6c-43e1-a51e-176b76235fd9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb06cafd-3775-4ab3-9be8-ece4a8f22245]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50100c5-a4f3-4716-ad82-5ac171cabfa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260]
Nov 18 15:55:35 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260] successful.
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[67baba3b-ada0-4b70-9981-8a3762ae9230]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fffdd18-a622-407e-b028-1cae5585f0ca]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:55:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e64663-d296-4f65-8e91-e4b6e14b170f]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:55:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDxKsGSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23663306438303636', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663306438303636', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:55:36 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:36 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:55:36 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:36 user nova-compute[74839]:   <serial>28b7ac32-fde9-4f10-acfc-df4c021102d6</serial>
Nov 18 15:55:36 user nova-compute[74839]: </disk>
Nov 18 15:55:36 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:55:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:55:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:55:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] No VIF found with MAC fa:16:3e:97:69:62, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:55:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-37ae30c2-d596-4e5e-aa7f-3bbc97ef0e24 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.221s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd is timed out.
Nov 18 15:55:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config.
Nov 18 15:55:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFqdtUYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:55:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4696ddf-ad41-449b-a741-530f587fbbe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:55:47 user nova-compute[74839]: No targets found.
Nov 18 15:55:47 user nova-compute[74839]: iSNS:
Nov 18 15:55:47 user nova-compute[74839]: No targets found.
Nov 18 15:55:47 user nova-compute[74839]: STATIC:
Nov 18 15:55:47 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6
Nov 18 15:55:47 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:55:47 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:55:47 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7
Nov 18 15:55:47 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:55:47 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:55:47 user nova-compute[74839]: FIRMWARE:
Nov 18 15:55:47 user nova-compute[74839]: No targets found.
Nov 18 15:55:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:55:47 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:55:47 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bd9f0e-e1ef-496b-a8c2-83ecd5e6039c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:47 user nova-compute[74839]: INFO nova.compute.manager [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Terminating instance
Nov 18 15:55:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d526be-2ac2-4ecf-8ef5-3a14a07400ad]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:47 user nova-compute[74839]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:55:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 (non-flash)
Nov 18 15:55:47 user nova-compute[74839]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:55:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480515090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eab33d6-0863-405f-9db3-f372c9c93ac7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396868f-4da1-42f7-b403-e901a8bc7f47]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f61fa1-bd58-4aa8-89b2-418032022de6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc46c7f6-6f6f-4df4-9d22-5fd838bf3b0c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcba3e9a-5fe6-4f31-9692-67987008862e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b9526-c22c-41bd-9bf9-b619e9274421]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260]
Nov 18 15:55:48 user nova-compute[74839]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7, portal: 172.16.0.220,3260] successful.
Nov 18 15:55:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-unplugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] No waiting events found dispatching network-vif-unplugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-be8df6ab-ac02-4c50-91f1-1ab5a1838829 req-051176ec-c1e5-495c-a037-7626019bd486 service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-unplugged-c799ed01-94bb-47bd-85a4-36f181a215ba for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef6acdf-6758-4944-a598-c7c231c738b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b352334-6153-425d-8f8c-4733dcdb2f41]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== disconnect_volume: return (361ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Instance destroyed successfully.
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lazy-loading 'resources' on Instance uuid df4b8778-e410-4771-99f8-eefb3aeb39d2 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2006690769',display_name='tempest-ServerActionsTestOtherA-server-2006690769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2006690769',id=17,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxzP6w1YUVJtwFwb17UbekAfqQxsU4rHUUEdUC6ETYgM0v7haGqXM59wgSJQr02JeeOXL5K1baVEzsNmhL36Js3d1MWfV4k3MoDvx53AkFT9mt82Tkm0Fgsb181EvbAoQ==',key_name='tempest-keypair-1749273093',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='572badc0c30b4e3ba5b41b49cb2f8ed6',ramdisk_id='',reservation_id='r-hzvj61et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-89343349',owner_user_name='tempest-ServerActionsTestOtherA-89343349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5789c3f8f97b4d58871c77cdd19b969a',uuid=df4b8778-e410-4771-99f8-eefb3aeb39d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converting VIF {"id": "c799ed01-94bb-47bd-85a4-36f181a215ba", "address": "fa:16:3e:3a:df:43", "network": {"id": "9995b8b5-526e-4dd9-aab3-5f8d019d6a38", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-181801797-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "572badc0c30b4e3ba5b41b49cb2f8ed6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc799ed01-94", "ovs_interfaceid": "c799ed01-94bb-47bd-85a4-36f181a215ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG os_vif [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc799ed01-94, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76eedb55-0280-40f2-af7d-cdaa862cd65a) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:48 user nova-compute[74839]: INFO os_vif [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:df:43,bridge_name='br-int',has_traffic_filtering=True,id=c799ed01-94bb-47bd-85a4-36f181a215ba,network=Network(9995b8b5-526e-4dd9-aab3-5f8d019d6a38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc799ed01-94')
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Deleting instance files /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2_del
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Deletion of /opt/stack/data/nova/instances/df4b8778-e410-4771-99f8-eefb3aeb39d2_del complete
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.compute.manager [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-395245a1-e59d-4183-aebd-b1be4907bad8 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.compute.manager [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Detaching volume 28b7ac32-fde9-4f10-acfc-df4c021102d6
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Took 0.47 seconds to deallocate network for instance.
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-6f7a98da-5a17-4ef4-a884-6fcabb5314fa req-4e8be52f-4723-47e7-9633-e4534600bc0e service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-deleted-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.virt.block_device [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Attempting to driver detach volume 28b7ac32-fde9-4f10-acfc-df4c021102d6 from mountpoint /dev/vdb
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Attempting to detach device vdb from instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:55:48 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:48 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:55:48 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:48 user nova-compute[74839]:   <serial>28b7ac32-fde9-4f10-acfc-df4c021102d6</serial>
Nov 18 15:55:48 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:55:48 user nova-compute[74839]: </disk>
Nov 18 15:55:48 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:55:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully detached device vdb from instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 from the persistent domain config.
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:55:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:55:48 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:55:48 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 15:55:48 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:55:48 user nova-compute[74839]:   <serial>28b7ac32-fde9-4f10-acfc-df4c021102d6</serial>
Nov 18 15:55:48 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:55:48 user nova-compute[74839]: </disk>
Nov 18 15:55:48 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:55:49 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:49 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:49 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Deleted allocations for instance df4b8778-e410-4771-99f8-eefb3aeb39d2
Nov 18 15:55:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-542b17b8-f060-404d-bab0-406bc951b684 tempest-ServerActionsTestOtherA-89343349 tempest-ServerActionsTestOtherA-89343349-project-member] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.566s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:55:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] Acquiring lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] Lock "df4b8778-e410-4771-99f8-eefb3aeb39d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] No waiting events found dispatching network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:50 user nova-compute[74839]: WARNING nova.compute.manager [req-005af446-c5de-4ce3-a592-012a56dd619a req-15036fd3-2c5e-45ef-b388-80569a58730c service nova] [instance: df4b8778-e410-4771-99f8-eefb3aeb39d2] Received unexpected event network-vif-plugged-c799ed01-94bb-47bd-85a4-36f181a215ba for instance with vm_state deleted and task_state None.
Nov 18 15:55:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:51 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:55:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 15:55:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:55:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:55 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:57 user nova-compute[74839]: INFO nova.compute.manager [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Terminating instance
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-3df1f025-5075-4454-b626-3bf840924180 req-176738ae-f973-4cbd-ba62-7b7971cc77c8 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-unplugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Instance destroyed successfully.
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid ab26071c-3fb0-4d46-8742-319d53f5a6c3 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1198087756',display_name='tempest-ServerRescueNegativeTestJSON-server-1198087756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1198087756',id=23,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-t00lcqia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:41:52Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=ab26071c-3fb0-4d46-8742-319d53f5a6c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "address": "fa:16:3e:58:26:e9", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3253eaf4-d5", "ovs_interfaceid": "3253eaf4-d5b2-4757-81f6-726faa3af43d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG os_vif [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3253eaf4-d5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=455e5c2d-05ba-4cfb-a664-26ac64f33870) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:55:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:55:57 user nova-compute[74839]: INFO os_vif [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:26:e9,bridge_name='br-int',has_traffic_filtering=True,id=3253eaf4-d5b2-4757-81f6-726faa3af43d,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3253eaf4-d5')
Nov 18 15:55:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Deleting instance files /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3_del
Nov 18 15:55:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Deletion of /opt/stack/data/nova/instances/ab26071c-3fb0-4d46-8742-319d53f5a6c3_del complete
Nov 18 15:55:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:55:58 user nova-compute[74839]: INFO nova.compute.manager [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 18 15:55:58 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:55:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:55:58 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8455MB free_disk=25.283443450927734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance defa77fc-949a-4b92-b717-559fa24b7a2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:55:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:59 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Took 0.92 seconds to deallocate network for instance.
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-97a13ad5-809e-45ae-bc69-a125b59e39a7 req-fc78482d-709b-4958-9524-2ea9423cb437 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-deleted-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:59 user nova-compute[74839]: INFO nova.compute.manager [req-97a13ad5-809e-45ae-bc69-a125b59e39a7 req-fc78482d-709b-4958-9524-2ea9423cb437 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Neutron deleted interface 3253eaf4-d5b2-4757-81f6-726faa3af43d; detaching it from the instance and deleting it from the info cache
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.network.neutron [req-97a13ad5-809e-45ae-bc69-a125b59e39a7 req-fc78482d-709b-4958-9524-2ea9423cb437 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-97a13ad5-809e-45ae-bc69-a125b59e39a7 req-fc78482d-709b-4958-9524-2ea9423cb437 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Detach interface failed, port_id=3253eaf4-d5b2-4757-81f6-726faa3af43d, reason: Instance ab26071c-3fb0-4d46-8742-319d53f5a6c3 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] Acquiring lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] No waiting events found dispatching network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:55:59 user nova-compute[74839]: WARNING nova.compute.manager [req-97e816de-0f19-419d-b38c-d72321741768 req-8b526104-da3a-4403-abbd-f92db3178692 service nova] [instance: ab26071c-3fb0-4d46-8742-319d53f5a6c3] Received unexpected event network-vif-plugged-3253eaf4-d5b2-4757-81f6-726faa3af43d for instance with vm_state deleted and task_state None.
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:59 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Deleted allocations for instance ab26071c-3fb0-4d46-8742-319d53f5a6c3
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-5ca09e55-44a1-470c-9fda-b0e4dc4a3c2f tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "ab26071c-3fb0-4d46-8742-319d53f5a6c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:55:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:56:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 is timed out.
Nov 18 15:56:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully detached device vdb from instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 from the live domain config.
Nov 18 15:56:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDxKsGSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:09 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3576dd35-e543-47c5-aa1e-fbbeafbec92a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:56:09 user nova-compute[74839]: No targets found.
Nov 18 15:56:09 user nova-compute[74839]: iSNS:
Nov 18 15:56:09 user nova-compute[74839]: No targets found.
Nov 18 15:56:09 user nova-compute[74839]: STATIC:
Nov 18 15:56:09 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6
Nov 18 15:56:09 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:56:09 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:56:09 user nova-compute[74839]: FIRMWARE:
Nov 18 15:56:09 user nova-compute[74839]: No targets found.
Nov 18 15:56:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:56:09 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:56:09 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49872acd-90f7-4cf6-a530-a0e4871923cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d8e74e-ed66-46f1-8073-89dbbad64c27]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:56:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 (non-flash)
Nov 18 15:56:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48023f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f672026-4555-45e5-9a0e-e605d83cdddc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855df45-a229-47cb-9023-5057ca657b51]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38aec8a-4ec8-4ae9-beda-83239bdc3f46]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbaa64e-4880-4975-817c-aa173ebae61e]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[857310d2-9fa8-4e35-8c2f-938a3fcb440a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1686461-bc51-4324-b5b2-4dd1b1822623]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260]
Nov 18 15:56:09 user nova-compute[74839]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6, portal: 172.16.0.220,3260] successful.
Nov 18 15:56:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d86b18-bfe3-4cbe-9971-12bb4af6e7d2]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== disconnect_volume: return (286ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'flavor' on Instance uuid 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f34936e5-f09f-4f81-92de-a8344e7f892f tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.649s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:10 user nova-compute[74839]: INFO nova.compute.manager [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Terminating instance
Nov 18 15:56:10 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-unplugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] No waiting events found dispatching network-vif-unplugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:10 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ab37267-d302-425f-8dcf-b620d7e8f515 req-b2a606c3-21f2-42b0-9ce8-7383f7224d9b service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-unplugged-f45f9ed0-9246-41da-bc3b-1667840ac327 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:56:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Instance destroyed successfully.
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lazy-loading 'resources' on Instance uuid 7e3fe391-7d5f-40b0-900c-3c07f4fdd128 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-247530748',display_name='tempest-VolumesSnapshotTestJSON-instance-247530748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-247530748',id=38,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn5eKqFlYF1bftmnQrVb6ud1r8C/3pYqQPkzL67l2boWzZ7ttHHnMEhh+fMYfVgHv9UPOWEzatlRLVXAxzWKuKMRYun5ODE6qVhFrxVdwmlZg/Omn4ZSQPXIPBlfHGOUA==',key_name='tempest-keypair-1043061308',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:53:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7daccded38c4ddf9815114b16e9e798',ramdisk_id='',reservation_id='r-4kl4ci00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1293713294',owner_user_name='tempest-VolumesSnapshotTestJSON-1293713294-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baefb1ed20034faa83b9872267e74460',uuid=7e3fe391-7d5f-40b0-900c-3c07f4fdd128,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converting VIF {"id": "f45f9ed0-9246-41da-bc3b-1667840ac327", "address": "fa:16:3e:97:69:62", "network": {"id": "d36dbfba-b2fe-4439-975f-905acfd3d640", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1674571642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7daccded38c4ddf9815114b16e9e798", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf45f9ed0-92", "ovs_interfaceid": "f45f9ed0-9246-41da-bc3b-1667840ac327", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_vif [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf45f9ed0-92, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db4aaa4-2c40-4369-97bb-8789feed0da7) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:11 user nova-compute[74839]: INFO os_vif [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:62,bridge_name='br-int',has_traffic_filtering=True,id=f45f9ed0-9246-41da-bc3b-1667840ac327,network=Network(d36dbfba-b2fe-4439-975f-905acfd3d640),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf45f9ed0-92')
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:28b7ac32-fde9-4f10-acfc-df4c021102d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDxKsGSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:11 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a1467cb6-eaa1-4092-a255-379c83252a82]: Unexpected error while running command.
Nov 18 15:56:11 user nova-compute[74839]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 15:56:11 user nova-compute[74839]: Exit code: 21
Nov 18 15:56:11 user nova-compute[74839]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 15:56:11 user nova-compute[74839]: Stderr: '' {{(pid=85739) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 18 15:56:11 user nova-compute[74839]: Traceback (most recent call last):
Nov 18 15:56:11 user nova-compute[74839]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 18 15:56:11 user nova-compute[74839]:     ret = func(*f_args, **f_kwargs)
Nov 18 15:56:11 user nova-compute[74839]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 18 15:56:11 user nova-compute[74839]:     return func(*args, **kwargs)
Nov 18 15:56:11 user nova-compute[74839]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 18 15:56:11 user nova-compute[74839]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 18 15:56:11 user nova-compute[74839]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 18 15:56:11 user nova-compute[74839]:     return putils.execute(on_execute=on_execute,
Nov 18 15:56:11 user nova-compute[74839]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 18 15:56:11 user nova-compute[74839]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 18 15:56:11 user nova-compute[74839]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 15:56:11 user nova-compute[74839]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 15:56:11 user nova-compute[74839]: Exit code: 21
Nov 18 15:56:11 user nova-compute[74839]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 15:56:11 user nova-compute[74839]: Stderr: ''
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1467cb6-eaa1-4092-a255-379c83252a82]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 15:56:11 user nova-compute[74839]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 15:56:11 user nova-compute[74839]: Exit code: 21
Nov 18 15:56:11 user nova-compute[74839]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 15:56:11 user nova-compute[74839]: Stderr: ''
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 18 15:56:11 user nova-compute[74839]: ERROR os_brick.initiator.connectors.iscsi 
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74839) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] <== disconnect_volume: return (32ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:56:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Deleting instance files /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128_del
Nov 18 15:56:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Deletion of /opt/stack/data/nova/instances/7e3fe391-7d5f-40b0-900c-3c07f4fdd128_del complete
Nov 18 15:56:11 user nova-compute[74839]: INFO nova.compute.manager [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 15:56:11 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:56:11 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:12 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Took 0.76 seconds to deallocate network for instance.
Nov 18 15:56:12 user nova-compute[74839]: WARNING nova.volume.cinder [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Attachment 5f8ccec5-a9a6-42a3-a13b-3286f283a159 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5f8ccec5-a9a6-42a3-a13b-3286f283a159. (HTTP 404) (Request-ID: req-40c05b11-ba3c-4ea5-9288-5c2c069d5882)
Nov 18 15:56:12 user nova-compute[74839]: INFO nova.compute.manager [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Took 0.03 seconds to detach 1 volumes for instance.
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:12 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Deleted allocations for instance 7e3fe391-7d5f-40b0-900c-3c07f4fdd128
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f0fce32d-fc6f-4d6a-95dc-5cf9fce47c64 tempest-VolumesSnapshotTestJSON-1293713294 tempest-VolumesSnapshotTestJSON-1293713294-project-member] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] Acquiring lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] Lock "7e3fe391-7d5f-40b0-900c-3c07f4fdd128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] No waiting events found dispatching network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:12 user nova-compute[74839]: WARNING nova.compute.manager [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received unexpected event network-vif-plugged-f45f9ed0-9246-41da-bc3b-1667840ac327 for instance with vm_state deleted and task_state None.
Nov 18 15:56:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-3e3725f6-74e8-4491-ad6f-c033610aab10 req-fdc7e9d8-4213-4de8-aa81-f0b8594736f7 service nova] [instance: 7e3fe391-7d5f-40b0-900c-3c07f4fdd128] Received event network-vif-deleted-f45f9ed0-9246-41da-bc3b-1667840ac327 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG nova.objects.instance [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:20 user nova-compute[74839]: INFO nova.compute.manager [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attaching volume 160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 to /dev/vdb
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.utils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c0d79-1245-4357-9377-d223d0a75c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[39216ea4-f3dd-4f8a-aad1-99e7c874f903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe36c8-73b5-43e1-ac4d-885479745dc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c13ff-d5da-4e4f-b37e-f0182bcd0f29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:56:20 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:56:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac6aa5-bf3d-4c9d-bd76-7273b562e5fc]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG os_brick.utils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating existing volume attachment record: 1eeac21b-f723-4211-8d17-fc094c8a9e1f {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:56:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:22 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:56:22 user nova-compute[74839]: INFO nova.compute.claims [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Claim successful on node user
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:56:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.policy [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acb04bd192ff4c1b85dbe05b89802f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e183c20cc34ab0bd279ff421ab0b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:56:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Creating image(s)
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "/opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "/opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk 1073741824" returned: 0 in 0.052s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Successfully created port: 8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.199s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:56:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Cannot resize image /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Ensure instance console log exists: /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Successfully updated port: 8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquired lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-changed-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.compute.manager [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Refreshing instance network info cache due to event network-changed-8d447cce-9708-48a2-9e9e-28eaa3b8a694. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] Acquiring lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:24 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updating instance_info_cache with network_info: [{"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Releasing lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Instance network_info: |[{"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] Acquired lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.neutron [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Refreshing network info cache for port 8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Start _get_guest_xml network_info=[{"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:56:25 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:25 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1844190295',display_name='tempest-VolumesActionsTest-instance-1844190295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1844190295',id=40,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-ol4y3c17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:23Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=6c14a86f-0190-4115-a1f8-fdec484440f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.objects.instance [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c14a86f-0190-4115-a1f8-fdec484440f6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:56:25 user nova-compute[74839]:   <uuid>6c14a86f-0190-4115-a1f8-fdec484440f6</uuid>
Nov 18 15:56:25 user nova-compute[74839]:   <name>instance-00000028</name>
Nov 18 15:56:25 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:56:25 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:56:25 user nova-compute[74839]:   <metadata>
Nov 18 15:56:25 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:56:25 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:name>tempest-VolumesActionsTest-instance-1844190295</nova:name>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:56:25</nova:creationTime>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:56:25 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:56:25 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:owner>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:user uuid="acb04bd192ff4c1b85dbe05b89802f7d">tempest-VolumesActionsTest-1666497097-project-member</nova:user>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:project uuid="28e183c20cc34ab0bd279ff421ab0b1b">tempest-VolumesActionsTest-1666497097</nova:project>
Nov 18 15:56:25 user nova-compute[74839]:       </nova:owner>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:56:25 user nova-compute[74839]:       <nova:ports>
Nov 18 15:56:25 user nova-compute[74839]:         <nova:port uuid="8d447cce-9708-48a2-9e9e-28eaa3b8a694">
Nov 18 15:56:25 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:56:25 user nova-compute[74839]:         </nova:port>
Nov 18 15:56:25 user nova-compute[74839]:       </nova:ports>
Nov 18 15:56:25 user nova-compute[74839]:     </nova:instance>
Nov 18 15:56:25 user nova-compute[74839]:   </metadata>
Nov 18 15:56:25 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:56:25 user nova-compute[74839]:     <system>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="serial">6c14a86f-0190-4115-a1f8-fdec484440f6</entry>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="uuid">6c14a86f-0190-4115-a1f8-fdec484440f6</entry>
Nov 18 15:56:25 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:56:25 user nova-compute[74839]:     </system>
Nov 18 15:56:25 user nova-compute[74839]:   </sysinfo>
Nov 18 15:56:25 user nova-compute[74839]:   <os>
Nov 18 15:56:25 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:56:25 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:56:25 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:56:25 user nova-compute[74839]:   </os>
Nov 18 15:56:25 user nova-compute[74839]:   <features>
Nov 18 15:56:25 user nova-compute[74839]:     <acpi/>
Nov 18 15:56:25 user nova-compute[74839]:     <apic/>
Nov 18 15:56:25 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:56:25 user nova-compute[74839]:   </features>
Nov 18 15:56:25 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:56:25 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:56:25 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:56:25 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:56:25 user nova-compute[74839]:   </clock>
Nov 18 15:56:25 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:56:25 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:56:25 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:56:25 user nova-compute[74839]:   </cpu>
Nov 18 15:56:25 user nova-compute[74839]:   <devices>
Nov 18 15:56:25 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:56:25 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:56:25 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk"/>
Nov 18 15:56:25 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:56:25 user nova-compute[74839]:     </disk>
Nov 18 15:56:25 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:56:25 user nova-compute[74839]:       <mac address="fa:16:3e:b2:ea:ad"/>
Nov 18 15:56:25 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:25 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:56:25 user nova-compute[74839]:       <target dev="tap8d447cce-97"/>
Nov 18 15:56:25 user nova-compute[74839]:     </interface>
Nov 18 15:56:25 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:56:25 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/console.log" append="off"/>
Nov 18 15:56:25 user nova-compute[74839]:     </serial>
Nov 18 15:56:25 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:56:25 user nova-compute[74839]:     <video>
Nov 18 15:56:25 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:25 user nova-compute[74839]:     </video>
Nov 18 15:56:25 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:56:25 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:56:25 user nova-compute[74839]:     </rng>
Nov 18 15:56:25 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:56:25 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:56:25 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:56:25 user nova-compute[74839]:     </memballoon>
Nov 18 15:56:25 user nova-compute[74839]:   </devices>
Nov 18 15:56:25 user nova-compute[74839]: </domain>
Nov 18 15:56:25 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1844190295',display_name='tempest-VolumesActionsTest-instance-1844190295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1844190295',id=40,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-ol4y3c17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:23Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=6c14a86f-0190-4115-a1f8-fdec484440f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG os_vif [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a359e0fb-3e0a-5823-8461-c054d36eff0b', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d447cce-97, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d447cce-97, col_values=(('qos', UUID('383ee822-8964-4e43-a216-d8b243da5f75')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d447cce-97, col_values=(('external_ids', {'iface-id': '8d447cce-9708-48a2-9e9e-28eaa3b8a694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ea:ad', 'vm-uuid': '6c14a86f-0190-4115-a1f8-fdec484440f6'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:25 user nova-compute[74839]: INFO os_vif [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97')
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] No VIF found with MAC fa:16:3e:b2:ea:ad, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.neutron [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updated VIF entry in instance network info cache for port 8d447cce-9708-48a2-9e9e-28eaa3b8a694. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG nova.network.neutron [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updating instance_info_cache with network_info: [{"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bb1ed4d3-e031-4d98-8c1d-7b84c592be2c req-1fca6ada-a678-4730-b319-5e3f7b3277b0 service nova] Releasing lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCbqtwmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:26 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:26 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:26 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f0fa08-8cec-4c61-85f9-6e3cdc99a51a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:56:26 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[047b0d06-86e1-4c5d-b7dc-bdc94aaf63fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3] added
Nov 18 15:56:26 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9da250-cd80-49f5-bf47-e9ccc12f657e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65cbece-bb04-4944-baef-3fbed874b47d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCbqtwmK {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCbqtwmK" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c806b5-1a8b-4266-aaa0-d582089383dc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCbqtwmK'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496d876-e1a8-46ae-a43d-d59663860f18]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f57d5-10c2-40d3-a682-d429f3d0c820]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:56:26 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:56:26 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:26 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:56:26 user nova-compute[74839]: 
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa98079-a8aa-4da1-b907-bf9cb6ec1992]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260]
Nov 18 15:56:26 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260] successful.
Nov 18 15:56:26 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e951bb-873a-4e72-b5b6-8184b87c79ff]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2bc86f-5c06-4d7d-aedc-b0f0eacbce55]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)
Nov 18 15:56:26 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)
Nov 18 15:56:26 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c54520c-ac2c-4a23-a77a-168dc3c7d841]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] No waiting events found dispatching network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:27 user nova-compute[74839]: WARNING nova.compute.manager [req-59e0dfd0-1358-461a-9eb8-54a52590e854 req-80ba1d86-0bb8-48e2-8e4e-68f33755a44d service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received unexpected event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 for instance with vm_state building and task_state spawning.
Nov 18 15:56:27 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCbqtwmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23034313336666131', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313336666131', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.objects.instance [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 15:56:27 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:56:27 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:56:27 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:56:27 user nova-compute[74839]:   <serial>160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3</serial>
Nov 18 15:56:27 user nova-compute[74839]: </disk>
Nov 18 15:56:27 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] No VIF found with MAC fa:16:3e:1f:0b:7c, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:56:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-654d1aa5-8380-47c0-87ff-6a2b0d9a30bd tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.409s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:56:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Instance spawned successfully.
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] No waiting events found dispatching network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:29 user nova-compute[74839]: WARNING nova.compute.manager [req-1337e439-139a-4314-9931-8d336314de72 req-e0c7e3ca-4a9d-43cc-ab26-11e11d016b70 service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received unexpected event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 for instance with vm_state building and task_state spawning.
Nov 18 15:56:29 user nova-compute[74839]: INFO nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 18 15:56:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:56:29 user nova-compute[74839]: INFO nova.compute.manager [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Took 6.56 seconds to build instance.
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85874ade-4bba-4d3d-96ee-4f043e5b2123 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.685s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:29 user nova-compute[74839]: INFO nova.compute.manager [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Detaching volume 160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3
Nov 18 15:56:30 user nova-compute[74839]: INFO nova.virt.block_device [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Attempting to driver detach volume 160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 from mountpoint /dev/vdb
Nov 18 15:56:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Attempting to detach device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 15:56:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:56:30 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:56:30 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:56:30 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:56:30 user nova-compute[74839]:   <serial>160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3</serial>
Nov 18 15:56:30 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:56:30 user nova-compute[74839]: </disk>
Nov 18 15:56:30 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:56:30 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the persistent domain config.
Nov 18 15:56:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 15:56:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 15:56:30 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:56:30 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 15:56:30 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 15:56:30 user nova-compute[74839]:   <serial>160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3</serial>
Nov 18 15:56:30 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 15:56:30 user nova-compute[74839]: </disk>
Nov 18 15:56:30 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 15:56:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 15:56:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:44 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:56:44 user nova-compute[74839]: INFO nova.compute.claims [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Claim successful on node user
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:56:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.policy [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:56:45 user nova-compute[74839]: INFO nova.virt.block_device [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Booting with volume snapshot 7db511f2-a37c-4681-a7aa-ba2f967fb2b4 at /dev/vda
Nov 18 15:56:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Successfully created port: e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Successfully updated port: e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-changed-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Refreshing instance network info cache due to event network-changed-e1273809-2e23-4953-b231-0b1a128e10aa. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] Acquiring lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:56:46 user nova-compute[74839]: DEBUG nova.network.neutron [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updating instance_info_cache with network_info: [{"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Instance network_info: |[{"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] Acquired lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Refreshing network info cache for port e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updated VIF entry in instance network info cache for port e1273809-2e23-4953-b231-0b1a128e10aa. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updating instance_info_cache with network_info: [{"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ac4932c4-22a1-436b-a307-e4a094dfa617 req-46ed8270-a5f9-4679-81a4-5f816c41fa44 service nova] Releasing lock "refresh_cache-e255c1d2-7c3d-49c1-8081-11f80711e761" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:47 user nova-compute[74839]: INFO nova.compute.manager [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Terminating instance
Nov 18 15:56:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Instance destroyed successfully.
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lazy-loading 'resources' on Instance uuid defa77fc-949a-4b92-b717-559fa24b7a2c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:39:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-633021265',display_name='tempest-ServerRescueNegativeTestJSON-server-633021265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-633021265',id=22,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:44:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b08331710a14c4d85ccca3fd806055b',ramdisk_id='',reservation_id='r-0km87nrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1006144467',owner_user_name='tempest-ServerRescueNegativeTestJSON-1006144467-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:46:37Z,user_data=None,user_id='75cef6e9b30942779dd9d0fc689c3947',uuid=defa77fc-949a-4b92-b717-559fa24b7a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converting VIF {"id": "bac9dbee-a574-4473-afa0-4c6838c60212", "address": "fa:16:3e:7c:a4:25", "network": {"id": "a0ae342d-8dc2-428c-8853-53bed1d114b0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1099008882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b08331710a14c4d85ccca3fd806055b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbac9dbee-a5", "ovs_interfaceid": "bac9dbee-a574-4473-afa0-4c6838c60212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG os_vif [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbac9dbee-a5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e6aeec6-c124-4003-8a7f-46d6db8ba739) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:48 user nova-compute[74839]: INFO os_vif [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:25,bridge_name='br-int',has_traffic_filtering=True,id=bac9dbee-a574-4473-afa0-4c6838c60212,network=Network(a0ae342d-8dc2-428c-8853-53bed1d114b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbac9dbee-a5')
Nov 18 15:56:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Deleting instance files /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c_del
Nov 18 15:56:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Deletion of /opt/stack/data/nova/instances/defa77fc-949a-4b92-b717-559fa24b7a2c_del complete
Nov 18 15:56:48 user nova-compute[74839]: INFO nova.compute.manager [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 18 15:56:48 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:56:48 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:49 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Took 0.70 seconds to deallocate network for instance.
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c6e2fb4-0165-47a9-b8ef-afbeb7c093ba req-89019561-8dbb-4561-8e99-79de472a92f5 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Received event network-vif-deleted-bac9dbee-a574-4473-afa0-4c6838c60212 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:49 user nova-compute[74839]: INFO nova.compute.manager [req-9c6e2fb4-0165-47a9-b8ef-afbeb7c093ba req-89019561-8dbb-4561-8e99-79de472a92f5 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Neutron deleted interface bac9dbee-a574-4473-afa0-4c6838c60212; detaching it from the instance and deleting it from the info cache
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-9c6e2fb4-0165-47a9-b8ef-afbeb7c093ba req-89019561-8dbb-4561-8e99-79de472a92f5 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c6e2fb4-0165-47a9-b8ef-afbeb7c093ba req-89019561-8dbb-4561-8e99-79de472a92f5 service nova] [instance: defa77fc-949a-4b92-b717-559fa24b7a2c] Detach interface failed, port_id=bac9dbee-a574-4473-afa0-4c6838c60212, reason: Instance defa77fc-949a-4b92-b717-559fa24b7a2c could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:56:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:49 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Deleted allocations for instance defa77fc-949a-4b92-b717-559fa24b7a2c
Nov 18 15:56:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ebac7d34-2786-4dcd-b912-e1adce8b4e9e tempest-ServerRescueNegativeTestJSON-1006144467 tempest-ServerRescueNegativeTestJSON-1006144467-project-member] Lock "defa77fc-949a-4b92-b717-559fa24b7a2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:50 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd is timed out.
Nov 18 15:56:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully detached device vdb from instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd from the live domain config.
Nov 18 15:56:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCbqtwmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:50 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b585e2a-dbd8-4e08-87fa-16a88fec3c43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:56:50 user nova-compute[74839]: No targets found.
Nov 18 15:56:50 user nova-compute[74839]: iSNS:
Nov 18 15:56:50 user nova-compute[74839]: No targets found.
Nov 18 15:56:50 user nova-compute[74839]: STATIC:
Nov 18 15:56:50 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3
Nov 18 15:56:50 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:56:50 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:56:50 user nova-compute[74839]: FIRMWARE:
Nov 18 15:56:50 user nova-compute[74839]: No targets found.
Nov 18 15:56:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:56:50 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:56:50 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01abbcae-a63c-4d8f-a5e3-a1d28ffef72a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cfc968-a2d5-49e8-8aa0-bf2a7f899e29]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)
Nov 18 15:56:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 (non-flash)
Nov 18 15:56:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c6fdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e95a52-0420-4c23-a738-909a21ba71a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95d592-c17c-488f-a481-3d0029734b34]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f8d213-efa1-49b8-a1cf-48f16ad130bc]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f3271e-e2e9-4561-89de-3d0887689774]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e611bf-268c-4c29-9cc0-0eb86fdeea48]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec554714-f1b6-486c-9bf7-cf67e121a261]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260]
Nov 18 15:56:50 user nova-compute[74839]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3, portal: 172.16.0.220,3260] successful.
Nov 18 15:56:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:160c4c3b-80a0-42b8-b49f-e4b14a0bf5e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b181b2-382c-4e41-ae6d-f39c10fb5828]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] <== disconnect_volume: return (323ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:56:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.utils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c597e14e-0905-4e21-ac45-e207c5d9d864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[db973c83-dabd-47fe-9ac1-bada93b52bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bc3192-99c3-40d6-9616-9fde1397a82b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7299f0e-640d-4283-905c-9a96ff00133b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:56:51 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9454b576-de04-4a87-b050-f2c3abc9531e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG os_brick.utils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updating existing volume attachment record: 5b302f62-5f7a-4f30-b6b8-9ab4ac11d9f0 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG nova.objects.instance [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'flavor' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-698e8d12-0f54-4675-9a49-0c1c669cb3ca tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.818s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:51 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:52 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:56:52 user nova-compute[74839]: INFO nova.compute.claims [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Claim successful on node user
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:56:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.policy [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90da6d5104b14a1d8cc277239c6ffe44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd4b53b959f420aaa99aed52962cf44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:56:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Creating image(s)
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk 1073741824" returned: 0 in 0.051s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:56:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Successfully created port: 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Skipping network cache update for instance because it is Building. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Skipping network cache update for instance because it is Building. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Cannot resize image /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Ensure instance console log exists: /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating instance_info_cache with network_info: [{"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Successfully updated port: 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing instance network info cache due to event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance network_info: |[{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start _get_guest_xml network_info=[{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:54 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:54 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:56:54 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1592452155',display_name='tempest-ServerStableDeviceRescueTest-server-1592452155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1592452155',id=42,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjAYH8kg1G2Y/KPkecyGO/mDFmv5bsIUFUmHAnULqcx0q/Mccqm1Fqz6KKm5IQ5f1grMNfJOXpzoHchDksQeUvyNuV3gFR/fY9IBLkCy5698yjmKbtnqyz6Nc0xVimEeg==',key_name='tempest-keypair-686167618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd4b53b959f420aaa99aed52962cf44',ramdisk_id='',reservation_id='r-zvvcbwmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1600041166',owner_user_name='tempest-ServerStableDeviceRescueTest-1600041166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da6d5104b14a1d8cc277239c6ffe44',uuid=e62f7e86-92f9-4e29-8297-731c213237b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converting VIF {"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.objects.instance [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'pci_devices' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:56:55 user nova-compute[74839]:   <uuid>e62f7e86-92f9-4e29-8297-731c213237b6</uuid>
Nov 18 15:56:55 user nova-compute[74839]:   <name>instance-0000002a</name>
Nov 18 15:56:55 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:56:55 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:56:55 user nova-compute[74839]:   <metadata>
Nov 18 15:56:55 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:56:55 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1592452155</nova:name>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:56:54</nova:creationTime>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:56:55 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:56:55 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:owner>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:user uuid="90da6d5104b14a1d8cc277239c6ffe44">tempest-ServerStableDeviceRescueTest-1600041166-project-member</nova:user>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:project uuid="cfd4b53b959f420aaa99aed52962cf44">tempest-ServerStableDeviceRescueTest-1600041166</nova:project>
Nov 18 15:56:55 user nova-compute[74839]:       </nova:owner>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:56:55 user nova-compute[74839]:       <nova:ports>
Nov 18 15:56:55 user nova-compute[74839]:         <nova:port uuid="294162fa-bd9d-43ed-a388-14e9aa54a8bd">
Nov 18 15:56:55 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 15:56:55 user nova-compute[74839]:         </nova:port>
Nov 18 15:56:55 user nova-compute[74839]:       </nova:ports>
Nov 18 15:56:55 user nova-compute[74839]:     </nova:instance>
Nov 18 15:56:55 user nova-compute[74839]:   </metadata>
Nov 18 15:56:55 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:56:55 user nova-compute[74839]:     <system>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="serial">e62f7e86-92f9-4e29-8297-731c213237b6</entry>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="uuid">e62f7e86-92f9-4e29-8297-731c213237b6</entry>
Nov 18 15:56:55 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:56:55 user nova-compute[74839]:     </system>
Nov 18 15:56:55 user nova-compute[74839]:   </sysinfo>
Nov 18 15:56:55 user nova-compute[74839]:   <os>
Nov 18 15:56:55 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:56:55 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:56:55 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:56:55 user nova-compute[74839]:   </os>
Nov 18 15:56:55 user nova-compute[74839]:   <features>
Nov 18 15:56:55 user nova-compute[74839]:     <acpi/>
Nov 18 15:56:55 user nova-compute[74839]:     <apic/>
Nov 18 15:56:55 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:56:55 user nova-compute[74839]:   </features>
Nov 18 15:56:55 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:56:55 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:56:55 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:56:55 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:56:55 user nova-compute[74839]:   </clock>
Nov 18 15:56:55 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:56:55 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:56:55 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:56:55 user nova-compute[74839]:   </cpu>
Nov 18 15:56:55 user nova-compute[74839]:   <devices>
Nov 18 15:56:55 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:56:55 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:56:55 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk"/>
Nov 18 15:56:55 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:56:55 user nova-compute[74839]:     </disk>
Nov 18 15:56:55 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:56:55 user nova-compute[74839]:       <mac address="fa:16:3e:b2:48:96"/>
Nov 18 15:56:55 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:55 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:56:55 user nova-compute[74839]:       <target dev="tap294162fa-bd"/>
Nov 18 15:56:55 user nova-compute[74839]:     </interface>
Nov 18 15:56:55 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:56:55 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/console.log" append="off"/>
Nov 18 15:56:55 user nova-compute[74839]:     </serial>
Nov 18 15:56:55 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:56:55 user nova-compute[74839]:     <video>
Nov 18 15:56:55 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:55 user nova-compute[74839]:     </video>
Nov 18 15:56:55 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:56:55 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:56:55 user nova-compute[74839]:     </rng>
Nov 18 15:56:55 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:56:55 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:56:55 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:56:55 user nova-compute[74839]:     </memballoon>
Nov 18 15:56:55 user nova-compute[74839]:   </devices>
Nov 18 15:56:55 user nova-compute[74839]: </domain>
Nov 18 15:56:55 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1592452155',display_name='tempest-ServerStableDeviceRescueTest-server-1592452155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1592452155',id=42,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjAYH8kg1G2Y/KPkecyGO/mDFmv5bsIUFUmHAnULqcx0q/Mccqm1Fqz6KKm5IQ5f1grMNfJOXpzoHchDksQeUvyNuV3gFR/fY9IBLkCy5698yjmKbtnqyz6Nc0xVimEeg==',key_name='tempest-keypair-686167618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd4b53b959f420aaa99aed52962cf44',ramdisk_id='',reservation_id='r-zvvcbwmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1600041166',owner_user_name='tempest-ServerStableDeviceRescueTest-1600041166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da6d5104b14a1d8cc277239c6ffe44',uuid=e62f7e86-92f9-4e29-8297-731c213237b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converting VIF {"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG os_vif [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6535226d-f4a8-5c39-ab22-0c69d369c6f1', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap294162fa-bd, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap294162fa-bd, col_values=(('qos', UUID('545f625c-4c8d-4e52-8da0-515c5073fb57')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap294162fa-bd, col_values=(('external_ids', {'iface-id': '294162fa-bd9d-43ed-a388-14e9aa54a8bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:48:96', 'vm-uuid': 'e62f7e86-92f9-4e29-8297-731c213237b6'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:55 user nova-compute[74839]: INFO os_vif [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd')
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No VIF found with MAC fa:16:3e:b2:48:96, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated VIF entry in instance network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e9d4ff44-12f3-4c05-8461-6f101e18b740 req-b49bf9bf-5e97-40d5-b675-9dc756ae1fc9 service nova] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:56:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:56:56 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Creating image(s)
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Ensure instance console log exists: /opt/stack/data/nova/instances/e255c1d2-7c3d-49c1-8081-11f80711e761/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Start _get_guest_xml network_info=[{"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '5b302f62-5f7a-4f30-b6b8-9ab4ac11d9f0', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSawgefx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e255c1d2-7c3d-49c1-8081-11f80711e761', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccf6311b-38db-4130-aaa4-5ad09def1bbf', 'serial': 'ccf6311b-38db-4130-aaa4-5ad09def1bbf'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:56:56 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:56 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSawgefx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:56:56 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:56 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:56:56 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:56 user nova-compute[74839]: WARNING nova.compute.manager [req-934304ed-a24a-4c4e-8bc0-fde87080d76c req-3c759a5b-a3f6-4b63-b12a-d230ee70abfb service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state building and task_state spawning.
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b92c8c-152a-4a94-9c2e-8747bd988e0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:56:56 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc1240-9f4e-4be5-8d28-8948a31e7bf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf] added
Nov 18 15:56:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011e3c3-5112-4ba8-8144-0192961e0f0a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96fe5f-afc2-488f-bc5d-f9661387e9e3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSawgefx {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSawgefx" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a05c0-3c84-4179-a059-84ccdd0e26be]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vSawgefx'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e4e44-6274-4937-9513-0529bf5faf7a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de98f397-ba4c-4fd5-be83-54afa6fa0932]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:56:56 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:56:56 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:56 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:56:56 user nova-compute[74839]: 
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299fdbb-8193-4731-b140-87cc3b19f67b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260]
Nov 18 15:56:56 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260] successful.
Nov 18 15:56:56 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:56 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[839210b5-dd1e-4d74-be24-5072fb42a98b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b825d1-a60d-43cd-bc73-ce51d6a9768e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)
Nov 18 15:56:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)
Nov 18 15:56:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e55eff-806e-456a-a1d7-b0a0c1f73734]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSawgefx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26163386638383636', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163386638383636', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-905910134',display_name='tempest-TestVolumeBootPattern-server-905910134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-905910134',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-i59l77jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:45Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=e255c1d2-7c3d-49c1-8081-11f80711e761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.objects.instance [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid e255c1d2-7c3d-49c1-8081-11f80711e761 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:56:58 user nova-compute[74839]:   <uuid>e255c1d2-7c3d-49c1-8081-11f80711e761</uuid>
Nov 18 15:56:58 user nova-compute[74839]:   <name>instance-00000029</name>
Nov 18 15:56:58 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:56:58 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:56:58 user nova-compute[74839]:   <metadata>
Nov 18 15:56:58 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:56:58 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:56:58 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-server-905910134</nova:name>
Nov 18 15:56:58 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:56:56</nova:creationTime>
Nov 18 15:56:58 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:56:58 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:56:58 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:56:58 user nova-compute[74839]:       <nova:owner>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 15:56:58 user nova-compute[74839]:       </nova:owner>
Nov 18 15:56:58 user nova-compute[74839]:       <nova:ports>
Nov 18 15:56:58 user nova-compute[74839]:         <nova:port uuid="e1273809-2e23-4953-b231-0b1a128e10aa">
Nov 18 15:56:58 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:56:58 user nova-compute[74839]:         </nova:port>
Nov 18 15:56:58 user nova-compute[74839]:       </nova:ports>
Nov 18 15:56:58 user nova-compute[74839]:     </nova:instance>
Nov 18 15:56:58 user nova-compute[74839]:   </metadata>
Nov 18 15:56:58 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:56:58 user nova-compute[74839]:     <system>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="serial">e255c1d2-7c3d-49c1-8081-11f80711e761</entry>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="uuid">e255c1d2-7c3d-49c1-8081-11f80711e761</entry>
Nov 18 15:56:58 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:56:58 user nova-compute[74839]:     </system>
Nov 18 15:56:58 user nova-compute[74839]:   </sysinfo>
Nov 18 15:56:58 user nova-compute[74839]:   <os>
Nov 18 15:56:58 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:56:58 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:56:58 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:56:58 user nova-compute[74839]:   </os>
Nov 18 15:56:58 user nova-compute[74839]:   <features>
Nov 18 15:56:58 user nova-compute[74839]:     <acpi/>
Nov 18 15:56:58 user nova-compute[74839]:     <apic/>
Nov 18 15:56:58 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:56:58 user nova-compute[74839]:   </features>
Nov 18 15:56:58 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:56:58 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:56:58 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:56:58 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:56:58 user nova-compute[74839]:   </clock>
Nov 18 15:56:58 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:56:58 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:56:58 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:56:58 user nova-compute[74839]:   </cpu>
Nov 18 15:56:58 user nova-compute[74839]:   <devices>
Nov 18 15:56:58 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:56:58 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:56:58 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:56:58 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:56:58 user nova-compute[74839]:       <serial>ccf6311b-38db-4130-aaa4-5ad09def1bbf</serial>
Nov 18 15:56:58 user nova-compute[74839]:     </disk>
Nov 18 15:56:58 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:56:58 user nova-compute[74839]:       <mac address="fa:16:3e:0b:f2:47"/>
Nov 18 15:56:58 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:58 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:56:58 user nova-compute[74839]:       <target dev="tape1273809-2e"/>
Nov 18 15:56:58 user nova-compute[74839]:     </interface>
Nov 18 15:56:58 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:56:58 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/e255c1d2-7c3d-49c1-8081-11f80711e761/console.log" append="off"/>
Nov 18 15:56:58 user nova-compute[74839]:     </serial>
Nov 18 15:56:58 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:56:58 user nova-compute[74839]:     <video>
Nov 18 15:56:58 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:56:58 user nova-compute[74839]:     </video>
Nov 18 15:56:58 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:56:58 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:56:58 user nova-compute[74839]:     </rng>
Nov 18 15:56:58 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:56:58 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:56:58 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:56:58 user nova-compute[74839]:     </memballoon>
Nov 18 15:56:58 user nova-compute[74839]:   </devices>
Nov 18 15:56:58 user nova-compute[74839]: </domain>
Nov 18 15:56:58 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-905910134',display_name='tempest-TestVolumeBootPattern-server-905910134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-905910134',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-i59l77jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:56:45Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=e255c1d2-7c3d-49c1-8081-11f80711e761,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG os_vif [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d36c85a-0caa-5966-bc86-7260f3ca64a0', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1273809-2e, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1273809-2e, col_values=(('qos', UUID('9c04fefe-08dc-4166-98f9-7e41a84c7afc')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1273809-2e, col_values=(('external_ids', {'iface-id': 'e1273809-2e23-4953-b231-0b1a128e10aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f2:47', 'vm-uuid': 'e255c1d2-7c3d-49c1-8081-11f80711e761'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:58 user nova-compute[74839]: INFO os_vif [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e')
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:0b:f2:47, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.compute.manager [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:58 user nova-compute[74839]: WARNING nova.compute.manager [req-bd6c67e2-c7dc-4229-a753-16a43f4a3785 req-a76b523b-6373-43b8-9abf-f25207bc0402 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state building and task_state spawning.
Nov 18 15:56:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance spawned successfully.
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:56:58 user nova-compute[74839]: INFO nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 18 15:56:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:56:59 user nova-compute[74839]: INFO nova.compute.manager [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Took 6.16 seconds to build instance.
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-49b454fb-9664-487c-8e76-1032e62f6eff tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.310s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG nova.compute.manager [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] No waiting events found dispatching network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:56:59 user nova-compute[74839]: WARNING nova.compute.manager [req-c892be1a-e960-4de0-9b76-a6e4c152fe76 req-4ddf7020-d7bc-4f7f-8d8a-4b889f78091b service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received unexpected event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa for instance with vm_state building and task_state spawning.
Nov 18 15:56:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:56:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.32469940185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:56:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6c14a86f-0190-4115-a1f8-fdec484440f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e255c1d2-7c3d-49c1-8081-11f80711e761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] No waiting events found dispatching network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:57:01 user nova-compute[74839]: WARNING nova.compute.manager [req-2cd2f105-9842-4cbd-b74e-eafe8a204c2c req-0b4be42f-696a-448b-a06b-a6b908639602 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received unexpected event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa for instance with vm_state building and task_state spawning.
Nov 18 15:57:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Instance spawned successfully.
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:57:01 user nova-compute[74839]: INFO nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 18 15:57:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:57:01 user nova-compute[74839]: INFO nova.compute.manager [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Took 17.03 seconds to build instance.
Nov 18 15:57:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-88519027-eeea-4a5d-b600-457f7d9fb6aa tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.121s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:38 user nova-compute[74839]: INFO nova.compute.manager [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Terminating instance
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-unplugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] No waiting events found dispatching network-vif-unplugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8dbb4ba-0876-4a1d-a1e9-a04b28052585 req-e5dac865-1a0e-4a1e-8c2f-5ab5e8fe0111 service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-unplugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:57:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Instance destroyed successfully.
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lazy-loading 'resources' on Instance uuid 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:51:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1546383011',display_name='tempest-SnapshotDataIntegrityTests-server-1546383011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1546383011',id=37,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGig1frpyOLiNrzfWduRs1Xn7b7FkR/t0AQaUiPCVz6T6++OsNk6loO15BKdq1PvDQOqaRy9wnD1OBvCGifrMgnYasrr5sUHG693t8p5PPlGJG7KXDpYpaS74+CPvKyKMA==',key_name='tempest-keypair-1329986613',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:51:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce9324fb3f44158a16106b220d60a46',ramdisk_id='',reservation_id='r-uv4ymkhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-799976396',owner_user_name='tempest-SnapshotDataIntegrityTests-799976396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8831a016994a20afe7ad8895359ca4',uuid=1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converting VIF {"id": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "address": "fa:16:3e:1f:0b:7c", "network": {"id": "e5994971-a5e2-427f-aa66-d79de2ca5ea0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-954683634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce9324fb3f44158a16106b220d60a46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59918e6d-bd", "ovs_interfaceid": "59918e6d-bdf9-41dd-a107-f1e75278eb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG os_vif [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59918e6d-bd, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0fd747f-7e10-473f-9669-ee37e65181da) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:57:38 user nova-compute[74839]: INFO os_vif [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:0b:7c,bridge_name='br-int',has_traffic_filtering=True,id=59918e6d-bdf9-41dd-a107-f1e75278eb6f,network=Network(e5994971-a5e2-427f-aa66-d79de2ca5ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59918e6d-bd')
Nov 18 15:57:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Deleting instance files /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd_del
Nov 18 15:57:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Deletion of /opt/stack/data/nova/instances/1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd_del complete
Nov 18 15:57:39 user nova-compute[74839]: INFO nova.compute.manager [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 18 15:57:39 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:57:39 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:57:39 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:57:40 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Took 1.60 seconds to deallocate network for instance.
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-f4c2673c-e2df-4f91-b7c4-356cedfacd1f req-3e5a3aa8-5b9d-4212-91bf-0221ef13acda service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-deleted-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] Acquiring lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] No waiting events found dispatching network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:57:40 user nova-compute[74839]: WARNING nova.compute.manager [req-205bdcb6-7afc-46af-955f-8bb794000917 req-2f7ec711-fdfa-4382-9c37-e2ceab5e9ffe service nova] [instance: 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd] Received unexpected event network-vif-plugged-59918e6d-bdf9-41dd-a107-f1e75278eb6f for instance with vm_state deleted and task_state None.
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:57:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:40 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Deleted allocations for instance 1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd
Nov 18 15:57:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0396bc63-5a70-456c-b5bd-517f3ea595c6 tempest-SnapshotDataIntegrityTests-799976396 tempest-SnapshotDataIntegrityTests-799976396-project-member] Lock "1690cf9a-ca99-4cd2-9d03-883fa0cd8ecd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.850s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:50 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:52 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 15:57:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 15:57:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:57:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:57:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:57:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:57:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:57:55 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updating instance_info_cache with network_info: [{"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:57:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-6c14a86f-0190-4115-a1f8-fdec484440f6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:57:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:57:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:57:57 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:57:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:57:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:57:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=25.31244659423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 6c14a86f-0190-4115-a1f8-fdec484440f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e255c1d2-7c3d-49c1-8081-11f80711e761 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:57:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 15:58:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:13 user nova-compute[74839]: INFO nova.compute.manager [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Terminating instance
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-unplugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] No waiting events found dispatching network-vif-unplugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-cdf08d93-3a2a-4f91-94ed-050bd1c78eca req-ceb01e9a-4986-456b-a968-b8a5576de99b service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-unplugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:58:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Instance destroyed successfully.
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lazy-loading 'resources' on Instance uuid 6c14a86f-0190-4115-a1f8-fdec484440f6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1844190295',display_name='tempest-VolumesActionsTest-instance-1844190295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1844190295',id=40,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28e183c20cc34ab0bd279ff421ab0b1b',ramdisk_id='',reservation_id='r-ol4y3c17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1666497097',owner_user_name='tempest-VolumesActionsTest-1666497097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:56:29Z,user_data=None,user_id='acb04bd192ff4c1b85dbe05b89802f7d',uuid=6c14a86f-0190-4115-a1f8-fdec484440f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converting VIF {"id": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "address": "fa:16:3e:b2:ea:ad", "network": {"id": "a08de9b1-d9a9-49f9-b44c-db4ae5878add", "bridge": "br-int", "label": "tempest-VolumesActionsTest-189288071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28e183c20cc34ab0bd279ff421ab0b1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d447cce-97", "ovs_interfaceid": "8d447cce-9708-48a2-9e9e-28eaa3b8a694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG os_vif [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d447cce-97, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=383ee822-8964-4e43-a216-d8b243da5f75) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:13 user nova-compute[74839]: INFO os_vif [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:ea:ad,bridge_name='br-int',has_traffic_filtering=True,id=8d447cce-9708-48a2-9e9e-28eaa3b8a694,network=Network(a08de9b1-d9a9-49f9-b44c-db4ae5878add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d447cce-97')
Nov 18 15:58:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Deleting instance files /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6_del
Nov 18 15:58:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Deletion of /opt/stack/data/nova/instances/6c14a86f-0190-4115-a1f8-fdec484440f6_del complete
Nov 18 15:58:14 user nova-compute[74839]: INFO nova.compute.manager [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 18 15:58:14 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:14 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Took 0.37 seconds to deallocate network for instance.
Nov 18 15:58:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:58:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:14 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Deleted allocations for instance 6c14a86f-0190-4115-a1f8-fdec484440f6
Nov 18 15:58:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f107482c-83b7-47b8-ab9e-054ed140e536 tempest-VolumesActionsTest-1666497097 tempest-VolumesActionsTest-1666497097-project-member] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.476s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] Acquiring lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] Lock "6c14a86f-0190-4115-a1f8-fdec484440f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] No waiting events found dispatching network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:15 user nova-compute[74839]: WARNING nova.compute.manager [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received unexpected event network-vif-plugged-8d447cce-9708-48a2-9e9e-28eaa3b8a694 for instance with vm_state deleted and task_state None.
Nov 18 15:58:15 user nova-compute[74839]: DEBUG nova.compute.manager [req-1cea9d5a-5a10-4f06-b571-07461e2a7c83 req-22adebef-373a-4962-b024-9c1108817c8c service nova] [instance: 6c14a86f-0190-4115-a1f8-fdec484440f6] Received event network-vif-deleted-8d447cce-9708-48a2-9e9e-28eaa3b8a694 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:58:35 user nova-compute[74839]: INFO nova.compute.claims [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Claim successful on node user
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:58:35 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.policy [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eac4b47817134dcab6c9ac9fda42fc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d92dcbfc3a441b8166e16fcbf29ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:58:35 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Creating image(s)
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "/opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "/opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:36 user nova-compute[74839]: INFO nova.compute.manager [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Terminating instance
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.223s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk 1073741824" returned: 0 in 0.054s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.200s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-unplugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] No waiting events found dispatching network-vif-unplugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-5c13333e-68f0-4cba-bba6-3b29598f226d req-43d40e34-859c-4d46-a045-4c2cf2d9ae8e service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-unplugged-e1273809-2e23-4953-b231-0b1a128e10aa for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Successfully created port: 4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Cannot resize image /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Ensure instance console log exists: /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Instance destroyed successfully.
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid e255c1d2-7c3d-49c1-8081-11f80711e761 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-905910134',display_name='tempest-TestVolumeBootPattern-server-905910134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-905910134',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:57:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-i59l77jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:57:02Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=e255c1d2-7c3d-49c1-8081-11f80711e761,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "e1273809-2e23-4953-b231-0b1a128e10aa", "address": "fa:16:3e:0b:f2:47", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1273809-2e", "ovs_interfaceid": "e1273809-2e23-4953-b231-0b1a128e10aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_vif [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1273809-2e, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c04fefe-08dc-4166-98f9-7e41a84c7afc) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:58:36 user nova-compute[74839]: INFO os_vif [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f2:47,bridge_name='br-int',has_traffic_filtering=True,id=e1273809-2e23-4953-b231-0b1a128e10aa,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1273809-2e')
Nov 18 15:58:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSawgefx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:58:36 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f86792-c2e5-43bb-9f5f-d2f59b815358]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 15:58:36 user nova-compute[74839]: No targets found.
Nov 18 15:58:36 user nova-compute[74839]: iSNS:
Nov 18 15:58:36 user nova-compute[74839]: No targets found.
Nov 18 15:58:36 user nova-compute[74839]: STATIC:
Nov 18 15:58:36 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf
Nov 18 15:58:36 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 15:58:36 user nova-compute[74839]:                 Iface Name: default
Nov 18 15:58:36 user nova-compute[74839]: FIRMWARE:
Nov 18 15:58:36 user nova-compute[74839]: No targets found.
Nov 18 15:58:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 15:58:36 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 15:58:36 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47468f8b-a2bf-4740-a2e9-e800ff1e72b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fdf074-c7c5-4703-b739-e35d0558a522]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)
Nov 18 15:58:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf (non-flash)
Nov 18 15:58:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48023c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[45190897-ddec-4e45-b3a0-944b5c089536]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Successfully updated port: 4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquired lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7339b32e-e76f-4a51-8348-a8a4dbf85022]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b345a73c-ce95-4ba7-af88-e2188a1179f5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-changed-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Refreshing instance network info cache due to event network-changed-4442e270-a924-4e3f-805a-cf9a1545788c. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] Acquiring lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac524153-7d22-4626-aacd-82c480423d9e]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e6398-6441-44a7-a744-8b3a0ea79861]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb2bea6-9bc1-4b08-a8b6-191eae25be27]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260]
Nov 18 15:58:37 user nova-compute[74839]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf, portal: 172.16.0.220,3260] successful.
Nov 18 15:58:37 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccf6311b-38db-4130-aaa4-5ad09def1bbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4175d7af-eb8d-4d83-9209-af7ab140d8a3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (348ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 15:58:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Deleting instance files /opt/stack/data/nova/instances/e255c1d2-7c3d-49c1-8081-11f80711e761_del
Nov 18 15:58:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Deletion of /opt/stack/data/nova/instances/e255c1d2-7c3d-49c1-8081-11f80711e761_del complete
Nov 18 15:58:37 user nova-compute[74839]: INFO nova.compute.manager [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating instance_info_cache with network_info: [{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Releasing lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Instance network_info: |[{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] Acquired lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Refreshing network info cache for port 4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Start _get_guest_xml network_info=[{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:58:37 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8283677',id=43,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCITqua4n/Vc36aJECVtgEdXoJ9qqGNJZKzy7wGK0DbVpPXnOBv+BelRgoR6qqSATUDVhiCf2TzaY2bKI0Md5QUdTccGXlaVhomAObzipM869qie3SnjM6DaofVdnjAsBg==',key_name='tempest-keypair-262607477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7d92dcbfc3a441b8166e16fcbf29ffd',ramdisk_id='',reservation_id='r-evpd0gt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eac4b47817134dcab6c9ac9fda42fc28',uuid=3cca156b-d21d-4fc9-91fd-e4374ec5e55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converting VIF {"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.objects.instance [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:58:37 user nova-compute[74839]:   <uuid>3cca156b-d21d-4fc9-91fd-e4374ec5e55c</uuid>
Nov 18 15:58:37 user nova-compute[74839]:   <name>instance-0000002b</name>
Nov 18 15:58:37 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:58:37 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:58:37 user nova-compute[74839]:   <metadata>
Nov 18 15:58:37 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:58:37 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782</nova:name>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:58:37</nova:creationTime>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:58:37 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:58:37 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:owner>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:user uuid="eac4b47817134dcab6c9ac9fda42fc28">tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member</nova:user>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:project uuid="e7d92dcbfc3a441b8166e16fcbf29ffd">tempest-TestServerVolumeAttachScenarioOldVersion-852890772</nova:project>
Nov 18 15:58:37 user nova-compute[74839]:       </nova:owner>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 15:58:37 user nova-compute[74839]:       <nova:ports>
Nov 18 15:58:37 user nova-compute[74839]:         <nova:port uuid="4442e270-a924-4e3f-805a-cf9a1545788c">
Nov 18 15:58:37 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 18 15:58:37 user nova-compute[74839]:         </nova:port>
Nov 18 15:58:37 user nova-compute[74839]:       </nova:ports>
Nov 18 15:58:37 user nova-compute[74839]:     </nova:instance>
Nov 18 15:58:37 user nova-compute[74839]:   </metadata>
Nov 18 15:58:37 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:58:37 user nova-compute[74839]:     <system>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="serial">3cca156b-d21d-4fc9-91fd-e4374ec5e55c</entry>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="uuid">3cca156b-d21d-4fc9-91fd-e4374ec5e55c</entry>
Nov 18 15:58:37 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:58:37 user nova-compute[74839]:     </system>
Nov 18 15:58:37 user nova-compute[74839]:   </sysinfo>
Nov 18 15:58:37 user nova-compute[74839]:   <os>
Nov 18 15:58:37 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:58:37 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:58:37 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:58:37 user nova-compute[74839]:   </os>
Nov 18 15:58:37 user nova-compute[74839]:   <features>
Nov 18 15:58:37 user nova-compute[74839]:     <acpi/>
Nov 18 15:58:37 user nova-compute[74839]:     <apic/>
Nov 18 15:58:37 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:58:37 user nova-compute[74839]:   </features>
Nov 18 15:58:37 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:58:37 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:58:37 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:58:37 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:58:37 user nova-compute[74839]:   </clock>
Nov 18 15:58:37 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:58:37 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:58:37 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:58:37 user nova-compute[74839]:   </cpu>
Nov 18 15:58:37 user nova-compute[74839]:   <devices>
Nov 18 15:58:37 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 15:58:37 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 15:58:37 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk"/>
Nov 18 15:58:37 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:58:37 user nova-compute[74839]:     </disk>
Nov 18 15:58:37 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:58:37 user nova-compute[74839]:       <mac address="fa:16:3e:6d:ac:4f"/>
Nov 18 15:58:37 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:58:37 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:58:37 user nova-compute[74839]:       <target dev="tap4442e270-a9"/>
Nov 18 15:58:37 user nova-compute[74839]:     </interface>
Nov 18 15:58:37 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:58:37 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/console.log" append="off"/>
Nov 18 15:58:37 user nova-compute[74839]:     </serial>
Nov 18 15:58:37 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:58:37 user nova-compute[74839]:     <video>
Nov 18 15:58:37 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:58:37 user nova-compute[74839]:     </video>
Nov 18 15:58:37 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:58:37 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:58:37 user nova-compute[74839]:     </rng>
Nov 18 15:58:37 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:58:37 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:58:37 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:58:37 user nova-compute[74839]:     </memballoon>
Nov 18 15:58:37 user nova-compute[74839]:   </devices>
Nov 18 15:58:37 user nova-compute[74839]: </domain>
Nov 18 15:58:37 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8283677',id=43,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCITqua4n/Vc36aJECVtgEdXoJ9qqGNJZKzy7wGK0DbVpPXnOBv+BelRgoR6qqSATUDVhiCf2TzaY2bKI0Md5QUdTccGXlaVhomAObzipM869qie3SnjM6DaofVdnjAsBg==',key_name='tempest-keypair-262607477',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7d92dcbfc3a441b8166e16fcbf29ffd',ramdisk_id='',reservation_id='r-evpd0gt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eac4b47817134dcab6c9ac9fda42fc28',uuid=3cca156b-d21d-4fc9-91fd-e4374ec5e55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converting VIF {"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG os_vif [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e3a02b9-08e6-50fc-87f9-e4feffaa4db5', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4442e270-a9, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4442e270-a9, col_values=(('qos', UUID('66657e1b-dc33-4874-b134-d8cc895334e7')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4442e270-a9, col_values=(('external_ids', {'iface-id': '4442e270-a924-4e3f-805a-cf9a1545788c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:ac:4f', 'vm-uuid': '3cca156b-d21d-4fc9-91fd-e4374ec5e55c'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: INFO os_vif [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9')
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] No VIF found with MAC fa:16:3e:6d:ac:4f, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:37 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Took 0.59 seconds to deallocate network for instance.
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-0ecf21c4-7946-496e-a47a-6f01a39429ad req-2fd6a2cf-0f09-471e-a3f2-8d642885c52a service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-deleted-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:37 user nova-compute[74839]: INFO nova.compute.manager [req-0ecf21c4-7946-496e-a47a-6f01a39429ad req-2fd6a2cf-0f09-471e-a3f2-8d642885c52a service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Neutron deleted interface e1273809-2e23-4953-b231-0b1a128e10aa; detaching it from the instance and deleting it from the info cache
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-0ecf21c4-7946-496e-a47a-6f01a39429ad req-2fd6a2cf-0f09-471e-a3f2-8d642885c52a service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-0ecf21c4-7946-496e-a47a-6f01a39429ad req-2fd6a2cf-0f09-471e-a3f2-8d642885c52a service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Detach interface failed, port_id=e1273809-2e23-4953-b231-0b1a128e10aa, reason: Instance e255c1d2-7c3d-49c1-8081-11f80711e761 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updated VIF entry in instance network info cache for port 4442e270-a924-4e3f-805a-cf9a1545788c. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating instance_info_cache with network_info: [{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e60edc94-615e-4af9-b36b-a850c143e0b8 req-72fd4a99-e8be-4fb4-ad31-128e293054cc service nova] Releasing lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] Acquiring lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] No waiting events found dispatching network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:38 user nova-compute[74839]: WARNING nova.compute.manager [req-99a01391-02ac-4102-9536-4efb75f3feb5 req-3d376841-a13e-4cb9-9f9b-a0222874ded8 service nova] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Received unexpected event network-vif-plugged-e1273809-2e23-4953-b231-0b1a128e10aa for instance with vm_state active and task_state deleting.
Nov 18 15:58:38 user nova-compute[74839]: INFO nova.compute.manager [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: e255c1d2-7c3d-49c1-8081-11f80711e761] Deleting volume: ccf6311b-38db-4130-aaa4-5ad09def1bbf {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:58:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:38 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance e255c1d2-7c3d-49c1-8081-11f80711e761
Nov 18 15:58:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-400f172e-e60e-4b13-b586-7ff1191fbdeb tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "e255c1d2-7c3d-49c1-8081-11f80711e761" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] No waiting events found dispatching network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:39 user nova-compute[74839]: WARNING nova.compute.manager [req-90ebc4b0-8c49-47d8-b4f1-9ec8d9209414 req-acd5fe80-68f6-4d5f-8749-51050dea3094 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received unexpected event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c for instance with vm_state building and task_state spawning.
Nov 18 15:58:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:58:40 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Instance spawned successfully.
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:40 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:58:41 user nova-compute[74839]: INFO nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 18 15:58:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] No waiting events found dispatching network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:58:41 user nova-compute[74839]: WARNING nova.compute.manager [req-869c03be-6774-4547-82bb-c4172485d4c7 req-d6a733d4-ad34-4867-9caf-617023ebb80f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received unexpected event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c for instance with vm_state building and task_state spawning.
Nov 18 15:58:41 user nova-compute[74839]: INFO nova.compute.manager [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Took 6.08 seconds to build instance.
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-12adaf42-2b3b-4255-951a-f919a247dd84 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.182s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:58:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing instance network info cache due to event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:58:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:58:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:58:43 user nova-compute[74839]: DEBUG nova.network.neutron [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:58:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated VIF entry in instance network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:58:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8881442e-af45-4053-967a-dccc7707c7f4 req-687dc539-c721-42a4-ad87-48e17b768ef3 service nova] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:58:45 user nova-compute[74839]: INFO nova.compute.manager [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] instance snapshotting
Nov 18 15:58:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Beginning live snapshot process
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json -f qcow2 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba.delta 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba.delta 1073741824" returned: 0 in 0.050s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 18 15:58:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:58:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74839) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 18 15:58:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 18 15:58:47 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 15:58:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba.delta /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:58:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba.delta /opt/stack/data/nova/instances/snapshots/tmpmmtdygrc/3c902e404d374c70aeed2c04266b86ba" returned: 0 in 0.670s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:58:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Snapshot extracted, beginning image upload
Nov 18 15:58:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Snapshot image upload complete
Nov 18 15:58:50 user nova-compute[74839]: INFO nova.compute.manager [None req-1649addd-b567-4d51-8fdf-e89300590240 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Took 5.48 seconds to snapshot the instance on the hypervisor.
Nov 18 15:58:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:53 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:58:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:58:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:58:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:58:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:58:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:59:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.260433197021484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 15:59:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:59:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 15:59:39 user nova-compute[74839]: INFO nova.compute.claims [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Claim successful on node user
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 15:59:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG nova.policy [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 15:59:39 user nova-compute[74839]: INFO nova.virt.block_device [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Booting with volume 5770fed9-cc91-44cc-94cc-6d8828e5020f at /dev/vda
Nov 18 15:59:39 user nova-compute[74839]: DEBUG os_brick.utils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f3ac9-45da-40a5-959c-d9c053d2d041]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[43970a93-ce7a-4d23-9282-f623ab475444]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca3209a-d439-43cd-93d4-6ea3a830d563]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80390a7-86a1-4977-8d4d-616ec867f834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:59:39 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 15:59:40 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 15:59:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdf0e47-bb9c-47c0-9c81-67131ce6d156]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG os_brick.utils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating existing volume attachment record: 2545434b-d062-4989-bb57-7cb345e5cdde {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 15:59:40 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Successfully created port: 61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Successfully updated port: 61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-changed-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Refreshing instance network info cache due to event network-changed-61cebc1a-fc39-46ce-b716-16177128c36a. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] Acquiring lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Instance network_info: |[{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] Acquired lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Refreshing network info cache for port 61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updated VIF entry in instance network info cache for port 61cebc1a-fc39-46ce-b716-16177128c36a. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG nova.network.neutron [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:59:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2fe69ab3-4f91-4316-b95a-29fe3c8a7d80 req-ee9bc1db-60f6-4231-aca9-047167a8cc90 service nova] Releasing lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 15:59:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 15:59:45 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Creating image(s)
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Ensure instance console log exists: /opt/stack/data/nova/instances/574e14df-1ce8-4935-aa10-df480c4d01de/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Start _get_guest_xml network_info=[{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '2545434b-d062-4989-bb57-7cb345e5cdde', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEqloOck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '574e14df-1ce8-4935-aa10-df480c4d01de', 'attached_at': '', 'detached_at': '', 'volume_id': '5770fed9-cc91-44cc-94cc-6d8828e5020f', 'serial': '5770fed9-cc91-44cc-94cc-6d8828e5020f'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 15:59:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:59:45 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEqloOck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 15:59:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:59:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 15:59:45 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e72d378-4f2a-44b5-9d85-f3379572c1f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 15:59:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e2abf-23d6-45ee-b837-8a587387484f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f] added
Nov 18 15:59:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb0518-4221-4d2a-ada3-e0981c1fb7af]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07840d23-2e4e-4ba2-be6b-26697a095718]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEqloOck {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEqloOck" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdffc611-0b23-4d53-a53c-4045be0988a3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEqloOck'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f412005-e200-4c4a-ba56-f797e8bb913d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffeee62-b20f-4092-a0f4-4040ceff6d7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:59:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 15:59:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:59:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 15:59:45 user nova-compute[74839]: 
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4fedd-bfab-4a37-b7f4-2c1f5c50d97a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260]
Nov 18 15:59:45 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260] successful.
Nov 18 15:59:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf430f-cf3f-4171-bbbb-435608b38381]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e07eb7-28f5-4743-a6af-47cb2d8efaee]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 15:59:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 15:59:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b950b3c-433e-446f-81b7-a30f27487325]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 15:59:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEqloOck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 15:59:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 15:59:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23965346434613464', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 15:59:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965346434613464', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1885786787',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm4cDQfNbAS3WuAwvGblLU3ap4ieCAkM7FG5wq2S5xCZZ9wzfYwREgJxvnO/5ysz6Agbf5dR9IvCfxnfc6ZjqZPsa3mMrHvWdNJtiQqqKKDXE9/19A+bYo2D/KBZ4jujg==',key_name='tempest-keypair-2117530852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-qmma6j4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=574e14df-1ce8-4935-aa10-df480c4d01de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.objects.instance [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid 574e14df-1ce8-4935-aa10-df480c4d01de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] End _get_guest_xml xml=<domain type="kvm">
Nov 18 15:59:47 user nova-compute[74839]:   <uuid>574e14df-1ce8-4935-aa10-df480c4d01de</uuid>
Nov 18 15:59:47 user nova-compute[74839]:   <name>instance-0000002c</name>
Nov 18 15:59:47 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 15:59:47 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 15:59:47 user nova-compute[74839]:   <metadata>
Nov 18 15:59:47 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 15:59:47 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 15:59:47 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1885786787</nova:name>
Nov 18 15:59:47 user nova-compute[74839]:       <nova:creationTime>2023-11-18 15:59:45</nova:creationTime>
Nov 18 15:59:47 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 15:59:47 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 15:59:47 user nova-compute[74839]:       </nova:flavor>
Nov 18 15:59:47 user nova-compute[74839]:       <nova:owner>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 15:59:47 user nova-compute[74839]:       </nova:owner>
Nov 18 15:59:47 user nova-compute[74839]:       <nova:ports>
Nov 18 15:59:47 user nova-compute[74839]:         <nova:port uuid="61cebc1a-fc39-46ce-b716-16177128c36a">
Nov 18 15:59:47 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 15:59:47 user nova-compute[74839]:         </nova:port>
Nov 18 15:59:47 user nova-compute[74839]:       </nova:ports>
Nov 18 15:59:47 user nova-compute[74839]:     </nova:instance>
Nov 18 15:59:47 user nova-compute[74839]:   </metadata>
Nov 18 15:59:47 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 15:59:47 user nova-compute[74839]:     <system>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="serial">574e14df-1ce8-4935-aa10-df480c4d01de</entry>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="uuid">574e14df-1ce8-4935-aa10-df480c4d01de</entry>
Nov 18 15:59:47 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 15:59:47 user nova-compute[74839]:     </system>
Nov 18 15:59:47 user nova-compute[74839]:   </sysinfo>
Nov 18 15:59:47 user nova-compute[74839]:   <os>
Nov 18 15:59:47 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 15:59:47 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 15:59:47 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 15:59:47 user nova-compute[74839]:   </os>
Nov 18 15:59:47 user nova-compute[74839]:   <features>
Nov 18 15:59:47 user nova-compute[74839]:     <acpi/>
Nov 18 15:59:47 user nova-compute[74839]:     <apic/>
Nov 18 15:59:47 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 15:59:47 user nova-compute[74839]:   </features>
Nov 18 15:59:47 user nova-compute[74839]:   <clock offset="utc">
Nov 18 15:59:47 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 15:59:47 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 15:59:47 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 15:59:47 user nova-compute[74839]:   </clock>
Nov 18 15:59:47 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 15:59:47 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 15:59:47 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 15:59:47 user nova-compute[74839]:   </cpu>
Nov 18 15:59:47 user nova-compute[74839]:   <devices>
Nov 18 15:59:47 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 15:59:47 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 15:59:47 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 15:59:47 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 15:59:47 user nova-compute[74839]:       <serial>5770fed9-cc91-44cc-94cc-6d8828e5020f</serial>
Nov 18 15:59:47 user nova-compute[74839]:     </disk>
Nov 18 15:59:47 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 15:59:47 user nova-compute[74839]:       <mac address="fa:16:3e:94:c0:61"/>
Nov 18 15:59:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:59:47 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 15:59:47 user nova-compute[74839]:       <target dev="tap61cebc1a-fc"/>
Nov 18 15:59:47 user nova-compute[74839]:     </interface>
Nov 18 15:59:47 user nova-compute[74839]:     <serial type="pty">
Nov 18 15:59:47 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/574e14df-1ce8-4935-aa10-df480c4d01de/console.log" append="off"/>
Nov 18 15:59:47 user nova-compute[74839]:     </serial>
Nov 18 15:59:47 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 15:59:47 user nova-compute[74839]:     <video>
Nov 18 15:59:47 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 15:59:47 user nova-compute[74839]:     </video>
Nov 18 15:59:47 user nova-compute[74839]:     <rng model="virtio">
Nov 18 15:59:47 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 15:59:47 user nova-compute[74839]:     </rng>
Nov 18 15:59:47 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 15:59:47 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 15:59:47 user nova-compute[74839]:       <stats period="10"/>
Nov 18 15:59:47 user nova-compute[74839]:     </memballoon>
Nov 18 15:59:47 user nova-compute[74839]:   </devices>
Nov 18 15:59:47 user nova-compute[74839]: </domain>
Nov 18 15:59:47 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1885786787',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm4cDQfNbAS3WuAwvGblLU3ap4ieCAkM7FG5wq2S5xCZZ9wzfYwREgJxvnO/5ysz6Agbf5dR9IvCfxnfc6ZjqZPsa3mMrHvWdNJtiQqqKKDXE9/19A+bYo2D/KBZ4jujg==',key_name='tempest-keypair-2117530852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-qmma6j4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=574e14df-1ce8-4935-aa10-df480c4d01de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG os_vif [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68978749-dc01-5225-98c9-fd3a286853b4', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61cebc1a-fc, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61cebc1a-fc, col_values=(('qos', UUID('234c081f-0155-4b63-9e4b-c1ad1706aaad')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61cebc1a-fc, col_values=(('external_ids', {'iface-id': '61cebc1a-fc39-46ce-b716-16177128c36a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:c0:61', 'vm-uuid': '574e14df-1ce8-4935-aa10-df480c4d01de'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:47 user nova-compute[74839]: INFO os_vif [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc')
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 15:59:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:94:c0:61, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] No waiting events found dispatching network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:59:48 user nova-compute[74839]: WARNING nova.compute.manager [req-83f2f8c9-d6c7-44c6-89dc-9af2f3b29b21 req-e0d2dbc5-ea9f-4889-812c-896b057ce44e service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received unexpected event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a for instance with vm_state building and task_state spawning.
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 15:59:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Instance spawned successfully.
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] No waiting events found dispatching network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 15:59:50 user nova-compute[74839]: WARNING nova.compute.manager [req-ef3bae89-9d61-4056-9975-2523272db7ba req-fd864ad4-4cbf-4a24-900d-3b78579a117f service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received unexpected event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a for instance with vm_state building and task_state spawning.
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 15:59:50 user nova-compute[74839]: INFO nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 18 15:59:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 15:59:50 user nova-compute[74839]: INFO nova.compute.manager [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Took 11.37 seconds to build instance.
Nov 18 15:59:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-586333a0-789c-4dc2-906c-db9ac1a4aef9 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.502s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:55 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:55 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating instance_info_cache with network_info: [{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 15:59:56 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 15:59:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 15:59:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 15:59:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:00:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=25.239669799804688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 574e14df-1ce8-4935-aa10-df480c4d01de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:00:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-changed-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Refreshing instance network info cache due to event network-changed-4442e270-a924-4e3f-805a-cf9a1545788c. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] Acquiring lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] Acquired lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG nova.network.neutron [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Refreshing network info cache for port 4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG nova.network.neutron [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updated VIF entry in instance network info cache for port 4442e270-a924-4e3f-805a-cf9a1545788c. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG nova.network.neutron [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating instance_info_cache with network_info: [{"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:00:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-359b880f-7f44-45df-9dda-0cf686e56cba req-1771fdac-4fd0-465f-9457-aa8faaa7600b service nova] Releasing lock "refresh_cache-3cca156b-d21d-4fc9-91fd-e4374ec5e55c" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:00:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lazy-loading 'flavor' on Instance uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:29 user nova-compute[74839]: INFO nova.compute.manager [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Attaching volume fc26702b-ef33-4d50-8baa-bd4c0a1b8185 to /dev/vdb
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.utils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1778416-845e-4f66-b907-92ca97615b11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035e12d-5f00-4a6a-b702-630fef1aad25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49af259-aed8-46a3-bc71-7658039336d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[07586448-4b36-4f71-bff9-1d3cb0fc79b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:00:29 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:00:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aae8d3-f80d-42f0-b025-747505a02b2d]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG os_brick.utils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:29 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating existing volume attachment record: 8798aa15-54db-45c8-afba-c9dbc7dfb43e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:00:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQxuAtgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:35 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[412e1ed3-2331-41d0-be3b-fbd144bcd202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:00:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51967a1-d519-418b-b162-893861dbcb0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185] added
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e67e409-2252-4190-967d-513a206c8ffe]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767cac9-33b2-492f-b093-ff41a3219dfd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQxuAtgK {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQxuAtgK" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906deb2-7115-4221-8a53-cab7171bcac3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CQxuAtgK'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06212412-1a73-453a-8fa6-7255192fb911]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc9be3-0b8c-4a72-b966-fa317773d0c8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b4053-753f-4fbf-b414-7c740caa65a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260]
Nov 18 16:00:35 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260] successful.
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18064f-97fc-4522-8466-9d075648eeb3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db179d-59a3-48bc-94fd-7cc686c4b020]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:35 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:35 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4da2ac7-badb-4ec3-b822-e75ef96f9ed8]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQxuAtgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:00:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'flavor' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:36 user nova-compute[74839]: INFO nova.compute.manager [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attaching volume 5ad58280-c884-41f7-a5cf-e4a8ca579195 to /dev/vdb
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26232643863383439', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232643863383439', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.utils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lazy-loading 'flavor' on Instance uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530f963-2a3c-4f8f-a9a5-fc26381e65eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:00:36 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:00:36 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:00:36 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:00:36 user nova-compute[74839]:   <serial>fc26702b-ef33-4d50-8baa-bd4c0a1b8185</serial>
Nov 18 16:00:36 user nova-compute[74839]: </disk>
Nov 18 16:00:36 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26db2690-45f7-45a2-bcb2-81792d81c13c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[247eed84-4279-4652-85ad-c27d97d3e91c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ee147-388a-4726-ab9d-4ee047a017a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:00:36 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:00:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8255dd09-80d5-4d1b-8bee-d522a2514240]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG os_brick.utils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating existing volume attachment record: 3663f068-32bb-44fc-a2ff-db7eb4fe93e4 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] No VIF found with MAC fa:16:3e:6d:ac:4f, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-de83b54e-d78a-4712-bd9d-27f4ed4e755a tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.419s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:00:37 user nova-compute[74839]: INFO nova.compute.claims [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Claim successful on node user
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:00:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:00:37 user nova-compute[74839]: DEBUG nova.policy [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f71eb7e6ae7f4f399d08eeb9ebc98097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eebaec30e6d43a7aa4ba5aa548d3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:00:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Creating image(s)
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:38 user nova-compute[74839]: INFO nova.compute.manager [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Detaching volume fc26702b-ef33-4d50-8baa-bd4c0a1b8185
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Successfully created port: 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.part --force-share --output=json" returned: 0 in 0.202s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.images [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] 9ed71f53-7f85-48d3-9e6a-5c08a9807498 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.part /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:38 user nova-compute[74839]: INFO nova.virt.block_device [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Attempting to driver detach volume fc26702b-ef33-4d50-8baa-bd4c0a1b8185 from mountpoint /dev/vdb
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Attempting to detach device vdb from instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:00:38 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:00:38 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:00:38 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:00:38 user nova-compute[74839]:   <serial>fc26702b-ef33-4d50-8baa-bd4c0a1b8185</serial>
Nov 18 16:00:38 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:00:38 user nova-compute[74839]: </disk>
Nov 18 16:00:38 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:00:38 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Successfully detached device vdb from instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c from the persistent domain config.
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:00:38 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:00:38 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:00:38 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:00:38 user nova-compute[74839]:   <serial>fc26702b-ef33-4d50-8baa-bd4c0a1b8185</serial>
Nov 18 16:00:38 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:00:38 user nova-compute[74839]: </disk>
Nov 18 16:00:38 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.part /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.converted" returned: 0 in 0.119s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.899s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Successfully updated port: 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing instance network info cache due to event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json" returned: 0 in 0.205s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871,backing_fmt=raw /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871,backing_fmt=raw /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk 1073741824" returned: 0 in 0.046s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "85afcaf9d3a3f62a195e14e8694fa5aaa8164871" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance network_info: |[{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Cannot resize image /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Ensure instance console log exists: /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start _get_guest_xml network_info=[{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:00:35Z,direct_url=<?>,disk_format='qcow2',id=9ed71f53-7f85-48d3-9e6a-5c08a9807498,min_disk=0,min_ram=0,name='tempest-scenario-img--2042174437',owner='7eebaec30e6d43a7aa4ba5aa548d3954',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:00:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '9ed71f53-7f85-48d3-9e6a-5c08a9807498'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:00:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:00:35Z,direct_url=<?>,disk_format='qcow2',id=9ed71f53-7f85-48d3-9e6a-5c08a9807498,min_disk=0,min_ram=0,name='tempest-scenario-img--2042174437',owner='7eebaec30e6d43a7aa4ba5aa548d3954',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:00:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:00:38Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'pci_devices' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:00:39 user nova-compute[74839]:   <uuid>a7ca78a5-091b-4e44-9c63-e96881ffeddc</uuid>
Nov 18 16:00:39 user nova-compute[74839]:   <name>instance-0000002d</name>
Nov 18 16:00:39 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:00:39 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:00:39 user nova-compute[74839]:   <metadata>
Nov 18 16:00:39 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:00:39 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:name>tempest-TestMinimumBasicScenario-server-1247292875</nova:name>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:00:39</nova:creationTime>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:00:39 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:00:39 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:owner>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:user uuid="f71eb7e6ae7f4f399d08eeb9ebc98097">tempest-TestMinimumBasicScenario-147307032-project-member</nova:user>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:project uuid="7eebaec30e6d43a7aa4ba5aa548d3954">tempest-TestMinimumBasicScenario-147307032</nova:project>
Nov 18 16:00:39 user nova-compute[74839]:       </nova:owner>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:root type="image" uuid="9ed71f53-7f85-48d3-9e6a-5c08a9807498"/>
Nov 18 16:00:39 user nova-compute[74839]:       <nova:ports>
Nov 18 16:00:39 user nova-compute[74839]:         <nova:port uuid="31296d0b-d5fa-4cb8-8292-7ddaf8855c99">
Nov 18 16:00:39 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 16:00:39 user nova-compute[74839]:         </nova:port>
Nov 18 16:00:39 user nova-compute[74839]:       </nova:ports>
Nov 18 16:00:39 user nova-compute[74839]:     </nova:instance>
Nov 18 16:00:39 user nova-compute[74839]:   </metadata>
Nov 18 16:00:39 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:00:39 user nova-compute[74839]:     <system>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="serial">a7ca78a5-091b-4e44-9c63-e96881ffeddc</entry>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="uuid">a7ca78a5-091b-4e44-9c63-e96881ffeddc</entry>
Nov 18 16:00:39 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:00:39 user nova-compute[74839]:     </system>
Nov 18 16:00:39 user nova-compute[74839]:   </sysinfo>
Nov 18 16:00:39 user nova-compute[74839]:   <os>
Nov 18 16:00:39 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:00:39 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:00:39 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:00:39 user nova-compute[74839]:   </os>
Nov 18 16:00:39 user nova-compute[74839]:   <features>
Nov 18 16:00:39 user nova-compute[74839]:     <acpi/>
Nov 18 16:00:39 user nova-compute[74839]:     <apic/>
Nov 18 16:00:39 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:00:39 user nova-compute[74839]:   </features>
Nov 18 16:00:39 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:00:39 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:00:39 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:00:39 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:00:39 user nova-compute[74839]:   </clock>
Nov 18 16:00:39 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:00:39 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:00:39 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:00:39 user nova-compute[74839]:   </cpu>
Nov 18 16:00:39 user nova-compute[74839]:   <devices>
Nov 18 16:00:39 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:00:39 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:00:39 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk"/>
Nov 18 16:00:39 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:00:39 user nova-compute[74839]:     </disk>
Nov 18 16:00:39 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:00:39 user nova-compute[74839]:       <mac address="fa:16:3e:47:d1:3d"/>
Nov 18 16:00:39 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:00:39 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:00:39 user nova-compute[74839]:       <target dev="tap31296d0b-d5"/>
Nov 18 16:00:39 user nova-compute[74839]:     </interface>
Nov 18 16:00:39 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:00:39 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/console.log" append="off"/>
Nov 18 16:00:39 user nova-compute[74839]:     </serial>
Nov 18 16:00:39 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:00:39 user nova-compute[74839]:     <video>
Nov 18 16:00:39 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:00:39 user nova-compute[74839]:     </video>
Nov 18 16:00:39 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:00:39 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:00:39 user nova-compute[74839]:     </rng>
Nov 18 16:00:39 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:00:39 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:00:39 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:00:39 user nova-compute[74839]:     </memballoon>
Nov 18 16:00:39 user nova-compute[74839]:   </devices>
Nov 18 16:00:39 user nova-compute[74839]: </domain>
Nov 18 16:00:39 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:00:38Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG os_vif [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15fbbddc-f723-58f8-b53f-0e84267e5663', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31296d0b-d5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31296d0b-d5, col_values=(('qos', UUID('e01363ac-556f-4bc6-ab57-52b0c6895f53')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31296d0b-d5, col_values=(('external_ids', {'iface-id': '31296d0b-d5fa-4cb8-8292-7ddaf8855c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d1:3d', 'vm-uuid': 'a7ca78a5-091b-4e44-9c63-e96881ffeddc'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:39 user nova-compute[74839]: INFO os_vif [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5')
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No VIF found with MAC fa:16:3e:47:d1:3d, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated VIF entry in instance network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:00:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-25457c89-00cc-477b-98bf-8595629dae4a req-3d86d1cc-a633-49cb-ab90-9a1285348dae service nova] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:00:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:41 user nova-compute[74839]: WARNING nova.compute.manager [req-b82bc026-59fd-4a01-abee-161cc5b90375 req-28cd3a53-ee93-46c5-8703-ca03fbeb6ae4 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state building and task_state spawning.
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:41 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:41 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:41 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:00:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55b667-54e7-44fb-be14-7d73085e2329]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:00:42 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7880e92-f542-4aac-8e7f-d0c2cdd07d02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195] added
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46620028-8c5b-4df3-a843-f307001fd2da]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a99979d-c609-471e-98e7-0ef7c354f177]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFilZtBm {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFilZtBm" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236e941-0070-4ccc-a646-7e0a323cc7e7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uFilZtBm'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5badaa8-2f94-4412-a73d-4bd5059a4e47]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd030b4-580e-4790-abb8-2853cff01a9b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c4e53-5f38-4eb7-90af-d61782024fd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260]
Nov 18 16:00:42 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260] successful.
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a59f2-3188-41f1-9030-b7fe0a3fd93c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee6a2fb-c1cc-47de-a0b6-455f0c46ea3e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:42 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be2905-4f3f-435f-ba4d-a7a744d70b6b]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:00:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23334356538646633', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334356538646633', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'flavor' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:00:43 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:00:43 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:00:43 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:00:43 user nova-compute[74839]:   <serial>5ad58280-c884-41f7-a5cf-e4a8ca579195</serial>
Nov 18 16:00:43 user nova-compute[74839]: </disk>
Nov 18 16:00:43 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:00:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance spawned successfully.
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:43 user nova-compute[74839]: WARNING nova.compute.manager [req-9b757e04-2d51-4d7d-8d62-5c0b4e031f59 req-bd8c0c58-1547-434d-a0e4-387fbba05995 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state building and task_state spawning.
Nov 18 16:00:43 user nova-compute[74839]: INFO nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:00:43 user nova-compute[74839]: INFO nova.compute.manager [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Took 6.14 seconds to build instance.
Nov 18 16:00:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8ae19024-b1ed-4224-ad83-956615c37135 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.236s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No VIF found with MAC fa:16:3e:b2:48:96, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:00:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2810e540-d3c5-4741-b9dd-81c7b890f4a8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.533s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:45 user nova-compute[74839]: INFO nova.compute.manager [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Rescuing
Nov 18 16:00:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:00:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:00:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:00:45 user nova-compute[74839]: DEBUG nova.network.neutron [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:00:45 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:00:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:46 user nova-compute[74839]: WARNING nova.compute.manager [req-2ba6e824-f2d0-4650-9b09-99b3e4262e5a req-177e268a-8f9d-4550-8885-a71b334ba341 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state active and task_state rescuing.
Nov 18 16:00:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance destroyed successfully.
Nov 18 16:00:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attempting a stable device rescue
Nov 18 16:00:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74839) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance directory exists: not creating {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 18 16:00:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Creating image(s)
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'trusted_certs' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:47 user nova-compute[74839]: DEBUG nova.virt.images [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] 39984a56-e6b2-4a6d-b577-a03d121bb84f was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 16:00:47 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 16:00:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.part /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.part /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.converted" returned: 0 in 0.314s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:48 user nova-compute[74839]: WARNING nova.compute.manager [req-fb85e043-091f-4a9c-b864-6b75820f0a10 req-f2c9c417-b7d7-4095-9726-bc2d387f8b23 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state active and task_state rescuing.
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.612s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c,backing_fmt=raw /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c,backing_fmt=raw /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue" returned: 0 in 0.048s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'migration_context' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Object Instance<e62f7e86-92f9-4e29-8297-731c213237b6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start _get_guest_xml network_info=[{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "vif_mac": "fa:16:3e:b2:48:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '39984a56-e6b2-4a6d-b577-a03d121bb84f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '3663f068-32bb-44fc-a2ff-db7eb4fe93e4', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e62f7e86-92f9-4e29-8297-731c213237b6', 'attached_at': '', 'detached_at': '', 'volume_id': '5ad58280-c884-41f7-a5cf-e4a8ca579195', 'serial': '5ad58280-c884-41f7-a5cf-e4a8ca579195'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'resources' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Object Instance<e62f7e86-92f9-4e29-8297-731c213237b6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'numa_topology' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Object Instance<e62f7e86-92f9-4e29-8297-731c213237b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:00:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'vcpu_model' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Object Instance<e62f7e86-92f9-4e29-8297-731c213237b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:48 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f9d0b-5302-49f4-9757-55f2e196f681]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uFilZtBm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 18 16:00:48 user nova-compute[74839]: node.name = iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:00:48 user nova-compute[74839]: node.tpgt = -1
Nov 18 16:00:48 user nova-compute[74839]: node.startup = automatic
Nov 18 16:00:48 user nova-compute[74839]: node.leading_login = No
Nov 18 16:00:48 user nova-compute[74839]: iface.iscsi_ifacename = default
Nov 18 16:00:48 user nova-compute[74839]: iface.net_ifacename = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.ipaddress = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.prefix_len = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.hwaddress = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.transport_name = tcp
Nov 18 16:00:48 user nova-compute[74839]: iface.initiatorname = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.vlan_id = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.vlan_priority = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.vlan_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.iface_num = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.mtu = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.port = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.bootproto = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.subnet_mask = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.gateway = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_alt_client_id_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_alt_client_id = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_dns = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_learn_iqn = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_req_vendor_id_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_vendor_id_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_vendor_id = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.dhcp_slp_da = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.fragmentation = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.gratuitous_arp = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.incoming_forwarding = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.tos_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.tos = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.ttl = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.delayed_ack = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.tcp_nagle = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.tcp_wsf_state = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.tcp_wsf = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.tcp_timer_scale = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.tcp_timestamp = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.redirect = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.def_task_mgmt_timeout = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.header_digest = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.data_digest = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.immediate_data = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.initial_r2t = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.data_seq_inorder = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.data_pdu_inorder = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.erl = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.max_receive_data_len = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.first_burst_len = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.max_outstanding_r2t = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.max_burst_len = 0
Nov 18 16:00:48 user nova-compute[74839]: iface.chap_auth = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.bidi_chap = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.strict_login_compliance = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.discovery_auth = <empty>
Nov 18 16:00:48 user nova-compute[74839]: iface.discovery_logout = <empty>
Nov 18 16:00:48 user nova-compute[74839]: node.discovery_address = <empty>
Nov 18 16:00:48 user nova-compute[74839]: node.discovery_port = 0
Nov 18 16:00:48 user nova-compute[74839]: node.discovery_type = static
Nov 18 16:00:48 user nova-compute[74839]: node.session.initial_cmdsn = 0
Nov 18 16:00:48 user nova-compute[74839]: node.session.initial_login_retry_max = 8
Nov 18 16:00:48 user nova-compute[74839]: node.session.xmit_thread_priority = -20
Nov 18 16:00:48 user nova-compute[74839]: node.session.cmds_max = 128
Nov 18 16:00:48 user nova-compute[74839]: node.session.queue_depth = 32
Nov 18 16:00:48 user nova-compute[74839]: node.session.nr_sessions = 1
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.authmethod = CHAP
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.username = uFilZtBm
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.password = ***
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.username_in = <empty>
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.password_in = <empty>
Nov 18 16:00:48 user nova-compute[74839]: node.session.auth.chap_algs = MD5
Nov 18 16:00:48 user nova-compute[74839]: node.session.timeo.replacement_timeout = 120
Nov 18 16:00:48 user nova-compute[74839]: node.session.err_timeo.abort_timeout = 15
Nov 18 16:00:48 user nova-compute[74839]: node.session.err_timeo.lu_reset_timeout = 30
Nov 18 16:00:48 user nova-compute[74839]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 18 16:00:48 user nova-compute[74839]: node.session.err_timeo.host_reset_timeout = 60
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.FastAbort = Yes
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.InitialR2T = No
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.ImmediateData = Yes
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.FirstBurstLength = 262144
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.MaxBurstLength = 16776192
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.DefaultTime2Retain = 0
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.DefaultTime2Wait = 2
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.MaxConnections = 1
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 18 16:00:48 user nova-compute[74839]: node.session.iscsi.ERL = 0
Nov 18 16:00:48 user nova-compute[74839]: node.session.scan = manual
Nov 18 16:00:48 user nova-compute[74839]: node.session.reopen_max = 0
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].address = 172.16.0.220
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].port = 3260
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].startup = manual
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].tcp.window_size = 524288
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].tcp.type_of_service = 0
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].timeo.logout_timeout = 15
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].timeo.login_timeout = 15
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].timeo.auth_timeout = 45
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].timeo.noop_out_interval = 5
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].timeo.noop_out_timeout = 5
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.HeaderDigest = None
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.DataDigest = None
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.IFMarker = No
Nov 18 16:00:48 user nova-compute[74839]: node.conn[0].iscsi.OFMarker = No
Nov 18 16:00:48 user nova-compute[74839]: # END RECORD
Nov 18 16:00:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5427f-c382-451d-acb4-69db14479f1d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567714b-7172-4bc7-9419-9b9dbc8d0cf6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFilZtBm {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uFilZtBm" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[279bba08-6bba-4fdf-834a-f638a162124c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uFilZtBm'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9c287-12a0-4d08-98d5-0f709e286d79]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc35744-27f3-4a3b-a714-6273d11b6089]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:48 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:48 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:48 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:48 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] HCTL ('35', '0', '0', 0) found on session 52 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[588f942f-66b2-4c20-9b0b-5550971e9595]: (4, ('0 0 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Searching for a device in session 52 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.166s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23334356538646633', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334356538646633', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1592452155',display_name='tempest-ServerStableDeviceRescueTest-server-1592452155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1592452155',id=42,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjAYH8kg1G2Y/KPkecyGO/mDFmv5bsIUFUmHAnULqcx0q/Mccqm1Fqz6KKm5IQ5f1grMNfJOXpzoHchDksQeUvyNuV3gFR/fY9IBLkCy5698yjmKbtnqyz6Nc0xVimEeg==',key_name='tempest-keypair-686167618',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:56:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfd4b53b959f420aaa99aed52962cf44',ramdisk_id='',reservation_id='r-zvvcbwmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1600041166',owner_user_name='tempest-ServerStableDeviceRescueTest-1600041166-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T15:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da6d5104b14a1d8cc277239c6ffe44',uuid=e62f7e86-92f9-4e29-8297-731c213237b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "vif_mac": "fa:16:3e:b2:48:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converting VIF {"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "vif_mac": "fa:16:3e:b2:48:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'pci_devices' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.objects.base [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Object Instance<e62f7e86-92f9-4e29-8297-731c213237b6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:00:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:00:48 user nova-compute[74839]:   <uuid>e62f7e86-92f9-4e29-8297-731c213237b6</uuid>
Nov 18 16:00:48 user nova-compute[74839]:   <name>instance-0000002a</name>
Nov 18 16:00:48 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:00:48 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:00:48 user nova-compute[74839]:   <metadata>
Nov 18 16:00:48 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:00:48 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1592452155</nova:name>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:00:48</nova:creationTime>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:00:48 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:00:48 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:owner>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:user uuid="90da6d5104b14a1d8cc277239c6ffe44">tempest-ServerStableDeviceRescueTest-1600041166-project-member</nova:user>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:project uuid="cfd4b53b959f420aaa99aed52962cf44">tempest-ServerStableDeviceRescueTest-1600041166</nova:project>
Nov 18 16:00:48 user nova-compute[74839]:       </nova:owner>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:00:48 user nova-compute[74839]:       <nova:ports>
Nov 18 16:00:48 user nova-compute[74839]:         <nova:port uuid="294162fa-bd9d-43ed-a388-14e9aa54a8bd">
Nov 18 16:00:48 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 18 16:00:48 user nova-compute[74839]:         </nova:port>
Nov 18 16:00:48 user nova-compute[74839]:       </nova:ports>
Nov 18 16:00:48 user nova-compute[74839]:     </nova:instance>
Nov 18 16:00:48 user nova-compute[74839]:   </metadata>
Nov 18 16:00:48 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:00:48 user nova-compute[74839]:     <system>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="serial">e62f7e86-92f9-4e29-8297-731c213237b6</entry>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="uuid">e62f7e86-92f9-4e29-8297-731c213237b6</entry>
Nov 18 16:00:48 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:00:48 user nova-compute[74839]:     </system>
Nov 18 16:00:48 user nova-compute[74839]:   </sysinfo>
Nov 18 16:00:48 user nova-compute[74839]:   <os>
Nov 18 16:00:48 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:00:48 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:00:48 user nova-compute[74839]:   </os>
Nov 18 16:00:48 user nova-compute[74839]:   <features>
Nov 18 16:00:48 user nova-compute[74839]:     <acpi/>
Nov 18 16:00:48 user nova-compute[74839]:     <apic/>
Nov 18 16:00:48 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:00:48 user nova-compute[74839]:   </features>
Nov 18 16:00:48 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:00:48 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:00:48 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:00:48 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:00:48 user nova-compute[74839]:   </clock>
Nov 18 16:00:48 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:00:48 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:00:48 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:00:48 user nova-compute[74839]:   </cpu>
Nov 18 16:00:48 user nova-compute[74839]:   <devices>
Nov 18 16:00:48 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:00:48 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:00:48 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk"/>
Nov 18 16:00:48 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:00:48 user nova-compute[74839]:     </disk>
Nov 18 16:00:48 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:00:48 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:00:48 user nova-compute[74839]:       <source dev="/dev/sdd"/>
Nov 18 16:00:48 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 16:00:48 user nova-compute[74839]:       <serial>5ad58280-c884-41f7-a5cf-e4a8ca579195</serial>
Nov 18 16:00:48 user nova-compute[74839]:     </disk>
Nov 18 16:00:48 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:00:48 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:00:48 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue"/>
Nov 18 16:00:48 user nova-compute[74839]:       <target dev="vdc" bus="virtio"/>
Nov 18 16:00:48 user nova-compute[74839]:       <boot order="1"/>
Nov 18 16:00:48 user nova-compute[74839]:     </disk>
Nov 18 16:00:48 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:00:48 user nova-compute[74839]:       <mac address="fa:16:3e:b2:48:96"/>
Nov 18 16:00:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:00:48 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:00:48 user nova-compute[74839]:       <target dev="tap294162fa-bd"/>
Nov 18 16:00:48 user nova-compute[74839]:     </interface>
Nov 18 16:00:48 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:00:48 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/console.log" append="off"/>
Nov 18 16:00:48 user nova-compute[74839]:     </serial>
Nov 18 16:00:48 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:00:48 user nova-compute[74839]:     <video>
Nov 18 16:00:48 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:00:48 user nova-compute[74839]:     </video>
Nov 18 16:00:48 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:00:48 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:00:48 user nova-compute[74839]:     </rng>
Nov 18 16:00:48 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:00:48 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:00:48 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:00:48 user nova-compute[74839]:     </memballoon>
Nov 18 16:00:48 user nova-compute[74839]:   </devices>
Nov 18 16:00:48 user nova-compute[74839]: </domain>
Nov 18 16:00:48 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:00:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance destroyed successfully.
Nov 18 16:00:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:00:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] No VIF found with MAC fa:16:3e:b2:48:96, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:00:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:50 user nova-compute[74839]: WARNING nova.compute.manager [req-dac41833-da86-4b2e-83dc-21844f4ed6d4 req-045cca44-a85d-498a-9774-3277b5a7b874 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state active and task_state rescuing.
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-63d6eead-8c9d-4cf7-bdad-bc079972d102 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:00:52 user nova-compute[74839]: WARNING nova.compute.manager [req-56b1aca7-5d67-4e8f-b014-134174ea388f req-3f80a15b-71c7-4b13-a812-33edf2b73071 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state rescued and task_state None.
Nov 18 16:00:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:00:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:00:58 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c is timed out.
Nov 18 16:00:59 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Successfully detached device vdb from instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c from the live domain config.
Nov 18 16:00:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQxuAtgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:00:59 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcf4cba-0fde-49c2-aec6-275d93fb4483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:00:59 user nova-compute[74839]: No targets found.
Nov 18 16:00:59 user nova-compute[74839]: iSNS:
Nov 18 16:00:59 user nova-compute[74839]: No targets found.
Nov 18 16:00:59 user nova-compute[74839]: STATIC:
Nov 18 16:00:59 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185
Nov 18 16:00:59 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:00:59 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:00:59 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:00:59 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:00:59 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:00:59 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f
Nov 18 16:00:59 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:00:59 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:00:59 user nova-compute[74839]: FIRMWARE:
Nov 18 16:00:59 user nova-compute[74839]: No targets found.
Nov 18 16:00:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:00:59 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:00:59 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5594b5e9-cba8-42be-b73f-aa4bf6dc1ddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[79515ce5-fc9e-4958-9e7c-ce435a8234a7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:59 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:59 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:00:59 user nova-compute[74839]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 (non-flash)
Nov 18 16:00:59 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:00:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a11e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce21be-a7be-4e8c-adf7-8abf3fdfb54d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5655f70b-c2c8-49bd-9823-10c6badac469]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea85d5-1d0f-44ff-80af-15e6c4de4f43]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c986cf-151d-4246-bf8d-82db38f4d14c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa7aac9-726b-40c5-9f4f-1b74dc425364]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e40816-bd76-4642-a7dd-910f319c8c6e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260]
Nov 18 16:00:59 user nova-compute[74839]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185, portal: 172.16.0.220,3260] successful.
Nov 18 16:00:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc26702b-ef33-4d50-8baa-bd4c0a1b8185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6126dc6-e0e2-494e-a0e7-271ea2bd79ac]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] <== disconnect_volume: return (320ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:00:59 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lazy-loading 'flavor' on Instance uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec5f34a5-78a4-43e4-98b8-d0b1091e1d49 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:01:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:01:01 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:01:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8392MB free_disk=25.045883178710938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 574e14df-1ce8-4935-aa10-df480c4d01de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a7ca78a5-091b-4e44-9c63-e96881ffeddc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:01:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-changed-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Refreshing instance network info cache due to event network-changed-61cebc1a-fc39-46ce-b716-16177128c36a. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] Acquiring lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] Acquired lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:01:29 user nova-compute[74839]: DEBUG nova.network.neutron [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Refreshing network info cache for port 61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:01:30 user nova-compute[74839]: DEBUG nova.network.neutron [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updated VIF entry in instance network info cache for port 61cebc1a-fc39-46ce-b716-16177128c36a. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:01:30 user nova-compute[74839]: DEBUG nova.network.neutron [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:01:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-23b661d6-0d59-4ffd-bd9f-ae3a83846509 req-29480360-b049-4e18-8618-32e2aa294a25 service nova] Releasing lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:01:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:32 user nova-compute[74839]: INFO nova.compute.manager [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Terminating instance
Nov 18 16:01:32 user nova-compute[74839]: DEBUG nova.compute.manager [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-unplugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] No waiting events found dispatching network-vif-unplugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-6a3952e5-6637-4847-9d2a-98f38bec57de req-86f748d6-0533-4df5-afa3-5f2d812df291 service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-unplugged-4442e270-a924-4e3f-805a-cf9a1545788c for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:01:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Instance destroyed successfully.
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.objects.instance [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lazy-loading 'resources' on Instance uuid 3cca156b-d21d-4fc9-91fd-e4374ec5e55c {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-828367782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8283677',id=43,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCITqua4n/Vc36aJECVtgEdXoJ9qqGNJZKzy7wGK0DbVpPXnOBv+BelRgoR6qqSATUDVhiCf2TzaY2bKI0Md5QUdTccGXlaVhomAObzipM869qie3SnjM6DaofVdnjAsBg==',key_name='tempest-keypair-262607477',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7d92dcbfc3a441b8166e16fcbf29ffd',ramdisk_id='',reservation_id='r-evpd0gt7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eac4b47817134dcab6c9ac9fda42fc28',uuid=3cca156b-d21d-4fc9-91fd-e4374ec5e55c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converting VIF {"id": "4442e270-a924-4e3f-805a-cf9a1545788c", "address": "fa:16:3e:6d:ac:4f", "network": {"id": "55142248-6609-4417-af9b-ded40251cbf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2014707417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7d92dcbfc3a441b8166e16fcbf29ffd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4442e270-a9", "ovs_interfaceid": "4442e270-a924-4e3f-805a-cf9a1545788c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG os_vif [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4442e270-a9, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66657e1b-dc33-4874-b134-d8cc895334e7) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:01:33 user nova-compute[74839]: INFO os_vif [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:ac:4f,bridge_name='br-int',has_traffic_filtering=True,id=4442e270-a924-4e3f-805a-cf9a1545788c,network=Network(55142248-6609-4417-af9b-ded40251cbf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4442e270-a9')
Nov 18 16:01:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Deleting instance files /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c_del
Nov 18 16:01:33 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Deletion of /opt/stack/data/nova/instances/3cca156b-d21d-4fc9-91fd-e4374ec5e55c_del complete
Nov 18 16:01:33 user nova-compute[74839]: INFO nova.compute.manager [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 18 16:01:33 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:01:33 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:01:34 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:01:34 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Took 0.62 seconds to deallocate network for instance.
Nov 18 16:01:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:34 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:01:34 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:01:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:34 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Deleted allocations for instance 3cca156b-d21d-4fc9-91fd-e4374ec5e55c
Nov 18 16:01:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-74f464d5-0a47-4daa-8fc2-e28da8b7f587 tempest-TestServerVolumeAttachScenarioOldVersion-852890772 tempest-TestServerVolumeAttachScenarioOldVersion-852890772-project-member] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] Acquiring lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] Lock "3cca156b-d21d-4fc9-91fd-e4374ec5e55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] No waiting events found dispatching network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:01:35 user nova-compute[74839]: WARNING nova.compute.manager [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received unexpected event network-vif-plugged-4442e270-a924-4e3f-805a-cf9a1545788c for instance with vm_state deleted and task_state None.
Nov 18 16:01:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-280caf59-71c2-471a-aa73-c7474b534452 req-7c2d713d-5671-4a7e-8fa6-93d977f36c8f service nova] [instance: 3cca156b-d21d-4fc9-91fd-e4374ec5e55c] Received event network-vif-deleted-4442e270-a924-4e3f-805a-cf9a1545788c {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:01:36 user nova-compute[74839]: INFO nova.compute.claims [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Claim successful on node user
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:01:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:01:36 user nova-compute[74839]: INFO nova.virt.block_device [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Booting with volume snapshot d7793103-111b-4237-81b5-12f8e3c4df05 at /dev/vda
Nov 18 16:01:36 user nova-compute[74839]: DEBUG nova.policy [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Successfully created port: cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Successfully updated port: cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-changed-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Refreshing instance network info cache due to event network-changed-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] Acquiring lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:01:37 user nova-compute[74839]: DEBUG nova.network.neutron [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updating instance_info_cache with network_info: [{"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Instance network_info: |[{"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] Acquired lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Refreshing network info cache for port cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updated VIF entry in instance network info cache for port cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updating instance_info_cache with network_info: [{"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-22e5b0fd-557f-46e7-86cf-76f9088119a0 req-303272d5-6a0b-4ab0-8f75-8d4056c8307a service nova] Releasing lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:01:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.utils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3681f6a-37d0-4d07-a79c-14731ae29a4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008bbfc-e95e-42e8-8f58-b1252edcf1c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e534756-5994-4d2d-8935-67414c09a61b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa071f-2b30-4bcb-85bd-47da3195cfd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:01:42 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:01:42 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc434c88-bef2-4607-b9cf-d1803007323e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG os_brick.utils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:01:42 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updating existing volume attachment record: 26085b58-8dab-44be-a47e-b55a6c7520d8 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:01:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:01:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Creating image(s)
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Ensure instance console log exists: /opt/stack/data/nova/instances/ab1f1b6e-9a65-4325-9246-ead8add841db/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Start _get_guest_xml network_info=[{"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T16:01:31Z,direct_url=<?>,disk_format='qcow2',id=3f348665-3fdd-49ed-9f01-a10eeaa3832c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-231335185',owner='5f1ac31c8bb643b6a6cab7d0c06d227d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T16:01:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '26085b58-8dab-44be-a47e-b55a6c7520d8', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbpKgoaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab1f1b6e-9a65-4325-9246-ead8add841db', 'attached_at': '', 'detached_at': '', 'volume_id': 'bee2709c-d476-4afc-92a6-ccc8423bea9f', 'serial': 'bee2709c-d476-4afc-92a6-ccc8423bea9f'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:01:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:01:47 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-18T16:01:31Z,direct_url=<?>,disk_format='qcow2',id=3f348665-3fdd-49ed-9f01-a10eeaa3832c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-231335185',owner='5f1ac31c8bb643b6a6cab7d0c06d227d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-18T16:01:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbpKgoaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:01:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:01:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:01:47 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0e6f3-8c1c-435e-92ad-8ba37e3d77e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:01:47 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54204ac5-fb29-466a-aff9-0ba76c112527]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f] added
Nov 18 16:01:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f42007-587a-4352-aede-b98f2e7ab327]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea6b80-2303-41be-90e9-067496235db8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbpKgoaA {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbpKgoaA" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e12b7e-3cbd-4d16-9723-fb3eac3d5771]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbpKgoaA'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae84c744-a2de-4063-b980-14cdc4e86695]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e6fb8-27e5-4c41-8926-ebfe7621ef78]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:01:47 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:01:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:01:47 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:01:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:01:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ccf11b-c605-4ad7-8c82-25d87d7b39b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260]
Nov 18 16:01:48 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260] successful.
Nov 18 16:01:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cae026-da88-4370-9ad3-bdbf6aa53c60]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[14913a6f-49cd-4ce7-9cb1-f290ee429658]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:01:48 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:01:48 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:01:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:01:48 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:01:48 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:01:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e585df2-1690-40dd-af36-0860fa2d0823]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbpKgoaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:01:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26564306366633137', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564306366633137', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-668562598',id=46,image_ref='3f348665-3fdd-49ed-9f01-a10eeaa3832c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJPEavGbabepGplaYLDbY/2DrJaluWGZUru4GWy45YexK2tY7oID+guqkVMHx3Vd4GVkr9P44maXsCZILBiP0+wHK/07lArcsDeAlM5LU/GADVM6gzXcYsIvXeqzXsFRA==',key_name='tempest-keypair-762813055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-0u1ny9a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1298499824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab1f1b6e-9a65-4325-9246-ead8add841db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid ab1f1b6e-9a65-4325-9246-ead8add841db {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:01:49 user nova-compute[74839]:   <uuid>ab1f1b6e-9a65-4325-9246-ead8add841db</uuid>
Nov 18 16:01:49 user nova-compute[74839]:   <name>instance-0000002e</name>
Nov 18 16:01:49 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:01:49 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:01:49 user nova-compute[74839]:   <metadata>
Nov 18 16:01:49 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:01:49 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-668562598</nova:name>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:01:47</nova:creationTime>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:01:49 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:01:49 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:owner>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 16:01:49 user nova-compute[74839]:       </nova:owner>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:root type="image" uuid="3f348665-3fdd-49ed-9f01-a10eeaa3832c"/>
Nov 18 16:01:49 user nova-compute[74839]:       <nova:ports>
Nov 18 16:01:49 user nova-compute[74839]:         <nova:port uuid="cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939">
Nov 18 16:01:49 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 18 16:01:49 user nova-compute[74839]:         </nova:port>
Nov 18 16:01:49 user nova-compute[74839]:       </nova:ports>
Nov 18 16:01:49 user nova-compute[74839]:     </nova:instance>
Nov 18 16:01:49 user nova-compute[74839]:   </metadata>
Nov 18 16:01:49 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:01:49 user nova-compute[74839]:     <system>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="serial">ab1f1b6e-9a65-4325-9246-ead8add841db</entry>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="uuid">ab1f1b6e-9a65-4325-9246-ead8add841db</entry>
Nov 18 16:01:49 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:01:49 user nova-compute[74839]:     </system>
Nov 18 16:01:49 user nova-compute[74839]:   </sysinfo>
Nov 18 16:01:49 user nova-compute[74839]:   <os>
Nov 18 16:01:49 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:01:49 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:01:49 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:01:49 user nova-compute[74839]:   </os>
Nov 18 16:01:49 user nova-compute[74839]:   <features>
Nov 18 16:01:49 user nova-compute[74839]:     <acpi/>
Nov 18 16:01:49 user nova-compute[74839]:     <apic/>
Nov 18 16:01:49 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:01:49 user nova-compute[74839]:   </features>
Nov 18 16:01:49 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:01:49 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:01:49 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:01:49 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:01:49 user nova-compute[74839]:   </clock>
Nov 18 16:01:49 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:01:49 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:01:49 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:01:49 user nova-compute[74839]:   </cpu>
Nov 18 16:01:49 user nova-compute[74839]:   <devices>
Nov 18 16:01:49 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:01:49 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:01:49 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 16:01:49 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:01:49 user nova-compute[74839]:       <serial>bee2709c-d476-4afc-92a6-ccc8423bea9f</serial>
Nov 18 16:01:49 user nova-compute[74839]:     </disk>
Nov 18 16:01:49 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:01:49 user nova-compute[74839]:       <mac address="fa:16:3e:d2:f9:2e"/>
Nov 18 16:01:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:01:49 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:01:49 user nova-compute[74839]:       <target dev="tapcf5fedf1-ff"/>
Nov 18 16:01:49 user nova-compute[74839]:     </interface>
Nov 18 16:01:49 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:01:49 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/ab1f1b6e-9a65-4325-9246-ead8add841db/console.log" append="off"/>
Nov 18 16:01:49 user nova-compute[74839]:     </serial>
Nov 18 16:01:49 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:01:49 user nova-compute[74839]:     <video>
Nov 18 16:01:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:01:49 user nova-compute[74839]:     </video>
Nov 18 16:01:49 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:01:49 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:01:49 user nova-compute[74839]:     </rng>
Nov 18 16:01:49 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:01:49 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:01:49 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:01:49 user nova-compute[74839]:     </memballoon>
Nov 18 16:01:49 user nova-compute[74839]:   </devices>
Nov 18 16:01:49 user nova-compute[74839]: </domain>
Nov 18 16:01:49 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-668562598',id=46,image_ref='3f348665-3fdd-49ed-9f01-a10eeaa3832c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJPEavGbabepGplaYLDbY/2DrJaluWGZUru4GWy45YexK2tY7oID+guqkVMHx3Vd4GVkr9P44maXsCZILBiP0+wHK/07lArcsDeAlM5LU/GADVM6gzXcYsIvXeqzXsFRA==',key_name='tempest-keypair-762813055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-0u1ny9a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1298499824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab1f1b6e-9a65-4325-9246-ead8add841db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG os_vif [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd93fd3dc-6a54-5db1-9b0d-a938eace5ad0', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5fedf1-ff, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf5fedf1-ff, col_values=(('qos', UUID('0d9a1ab2-af86-46ff-b413-f96445a9d243')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf5fedf1-ff, col_values=(('external_ids', {'iface-id': 'cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:f9:2e', 'vm-uuid': 'ab1f1b6e-9a65-4325-9246-ead8add841db'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:49 user nova-compute[74839]: INFO os_vif [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff')
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:01:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:d2:f9:2e, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] No waiting events found dispatching network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:01:50 user nova-compute[74839]: WARNING nova.compute.manager [req-7eebc3ef-8d14-4ddc-bcd2-65f7c1f48d70 req-a2b4d08c-1d7d-48fa-b8d8-1598b55012f2 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received unexpected event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 for instance with vm_state building and task_state spawning.
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:01:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Instance spawned successfully.
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:01:52 user nova-compute[74839]: INFO nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] No waiting events found dispatching network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:01:52 user nova-compute[74839]: WARNING nova.compute.manager [req-c29a4687-49a5-4d1e-9208-6a7dbc33a208 req-ca77d1ca-b09a-4943-a267-2acdd1abe9d6 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received unexpected event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 for instance with vm_state building and task_state spawning.
Nov 18 16:01:52 user nova-compute[74839]: INFO nova.compute.manager [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Took 16.74 seconds to build instance.
Nov 18 16:01:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-04104f68-04d7-49d0-9f73-674ae6da636a tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.852s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:01:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:01:57 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:01:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:01:58 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:01:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:01:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:02:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:01 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:02:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:02:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8476MB free_disk=25.068740844726562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 574e14df-1ce8-4935-aa10-df480c4d01de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a7ca78a5-091b-4e44-9c63-e96881ffeddc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab1f1b6e-9a65-4325-9246-ead8add841db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:02:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:31 user nova-compute[74839]: INFO nova.compute.manager [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Attaching volume f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 to /dev/vdb
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.utils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3dfdb-84c2-4b85-a209-4fe01d100ac5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cd142b-d4f2-452b-a2ba-57bb5f042ccd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb38d5-6810-4c23-85b6-dc6374fb7f6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9291eb1-4f27-4ac5-ba67-f88c0c979eab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:02:31 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:02:31 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[57feb7dd-5a24-4e75-9e35-3eb445958674]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG os_brick.utils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:02:31 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating existing volume attachment record: 4620f96d-8ff6-465d-90cc-27548917b622 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:02:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:36 user nova-compute[74839]: INFO nova.compute.manager [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Unrescuing
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:02:36 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:02:36 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:02:36 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dfd33d-d438-4840-9a74-c8b26bdab553]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:02:36 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d1f38-d679-4ec1-ba27-7448237f413c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1] added
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ac71b-2542-47dd-a7ec-98737d0b09d0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe205bb-1c85-41a8-813a-5106888d6ad1]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTsVgQcb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTsVgQcb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53abedb-1b55-494f-9d71-36d97fa3c87a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTsVgQcb'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85ea0f-f8d0-4aab-9d5d-09dc64348a27]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fe271-4fbf-4d74-9f53-b639c5bd13de]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'flavor' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a0579-d2c0-41e7-94cd-30fcaded6f5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]
Nov 18 16:02:36 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4318ea8-1f7e-42e7-aa8d-3d72a825e7bb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b83e698-e654-43cc-bd91-56bc6611260e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:36 user nova-compute[74839]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:36 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc59ae10-bec5-43a9-99e4-52f6c168e2c5]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:37 user nova-compute[74839]: WARNING nova.compute.manager [req-1a0906c7-a7a3-45dc-8300-7caffac1f7c9 req-7d7bd770-f797-4bf7-a4dc-8180bfbcc9a3 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state rescued and task_state unrescuing.
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing instance network info cache due to event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance destroyed successfully.
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated VIF entry in instance network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.network.neutron [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bac8ad32-e971-4081-86c3-685f5a9b08e6 req-f8856bb5-cdf7-463c-b819-27f0c9c47ccf service nova] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23661306562336335', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661306562336335', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.objects.instance [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:02:37 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:02:37 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 16:02:37 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:02:37 user nova-compute[74839]:   <serial>f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1</serial>
Nov 18 16:02:37 user nova-compute[74839]: </disk>
Nov 18 16:02:37 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:02:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:02:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:02:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No VIF found with MAC fa:16:3e:47:d1:3d, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:39 user nova-compute[74839]: WARNING nova.compute.manager [req-59b7c036-e43b-4dfe-8b13-94f178321fc7 req-4a6c2b5b-ca96-4ecf-a0ac-f19ce85f9a98 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state rescued and task_state unrescuing.
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-81b28b29-703a-4706-a274-32152cea46b6 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.070s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing instance network info cache due to event network-changed-294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] Acquiring lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] Acquired lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Refreshing network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updated VIF entry in instance network info cache for port 294162fa-bd9d-43ed-a388-14e9aa54a8bd. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [{"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-cadab301-8ed4-4f14-9385-d001f3ca3e72 req-8b42885b-8804-454b-a6eb-b4d1f0c8ef20 service nova] Releasing lock "refresh_cache-e62f7e86-92f9-4e29-8297-731c213237b6" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:41 user nova-compute[74839]: WARNING nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state rescued and task_state unrescuing.
Nov 18 16:02:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:41 user nova-compute[74839]: WARNING nova.compute.manager [req-59a6213c-0948-4118-8535-6674003fce6c req-e9fab653-4b0c-47c2-862c-a8a0016707a8 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state rescued and task_state unrescuing.
Nov 18 16:02:41 user nova-compute[74839]: DEBUG nova.compute.manager [None req-478cd966-864f-48ca-b1fd-21480334b5e8 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing instance network info cache due to event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated VIF entry in instance network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6f67358e-9777-40b6-a462-3f6f29f5e798 req-a0e9e4aa-6edc-4e01-bec2-1c2f68376b72 service nova] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing instance network info cache due to event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:46 user nova-compute[74839]: DEBUG nova.network.neutron [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:02:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated VIF entry in instance network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:02:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4af2422c-8c92-4ba7-b173-34cc0ed1ad05 req-7bf21209-cccd-46aa-b576-a6acba767831 service nova] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:49 user nova-compute[74839]: INFO nova.compute.manager [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Rebooting instance
Nov 18 16:02:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:02:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:02:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG nova.network.neutron [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:50 user nova-compute[74839]: WARNING nova.compute.manager [req-a4b30de5-7f92-4493-af37-a673676926c1 req-136b94ad-557b-4bb0-b082-4c5c89149c07 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:51 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance destroyed successfully.
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'resources' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:02:51Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31296d0b-d5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e01363ac-556f-4bc6-ab57-52b0c6895f53) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:02:51 user nova-compute[74839]: INFO os_vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5')
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:02:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3840ab65-c792-4cc1-8223-1f196321c014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:02:51 user nova-compute[74839]: No targets found.
Nov 18 16:02:51 user nova-compute[74839]: iSNS:
Nov 18 16:02:51 user nova-compute[74839]: No targets found.
Nov 18 16:02:51 user nova-compute[74839]: STATIC:
Nov 18 16:02:51 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f
Nov 18 16:02:51 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:02:51 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:02:51 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:02:51 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:02:51 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:02:51 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f
Nov 18 16:02:51 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:02:51 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:02:51 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:02:51 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:02:51 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:02:51 user nova-compute[74839]: FIRMWARE:
Nov 18 16:02:51 user nova-compute[74839]: No targets found.
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:02:51 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:02:51 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b69ff55-004f-41cd-9c42-080201fb77a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d35282-16f0-4d90-8f1f-cb80f8112566]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48013e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba5ae20-5fc8-4481-a0c7-78612dfb7e97]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb24c6-9839-4845-9162-557daecd5cce]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0dc51a-0d78-4727-8846-a6c8eead411b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4d44f7-1c66-4b58-bfb3-86e7024892e4]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0572eddb-325b-4892-acf4-93a89c74c87f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57a2e7c-0f5e-4c85-97b8-c7769d3a3dc3]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]
Nov 18 16:02:51 user nova-compute[74839]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc382a-6d97-4136-8628-4afa2e5a9e3c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== disconnect_volume: return (310ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start _get_guest_xml network_info=[{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9ed71f53-7f85-48d3-9e6a-5c08a9807498,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '9ed71f53-7f85-48d3-9e6a-5c08a9807498'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '4620f96d-8ff6-465d-90cc-27548917b622', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a7ca78a5-091b-4e44-9c63-e96881ffeddc', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'serial': 'f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:02:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:02:51 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9ed71f53-7f85-48d3-9e6a-5c08a9807498,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.objects.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Object Instance<a7ca78a5-091b-4e44-9c63-e96881ffeddc> lazy-loaded attributes: resources,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:02:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:02:51 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:02:51 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954febd-1af3-428e-b22b-d0fb40c98931]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:02:51 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4e8b3-5902-47fb-b2d9-516eba47b1ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1] added
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7812365b-d4b2-4c91-8933-9a52e48dd7d4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[be97585f-6191-4f5e-8cb6-7df4c6274e6b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTsVgQcb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTsVgQcb" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1631102b-8ca6-4e66-86f3-7e3caf8d6823]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTsVgQcb'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d9b26-2edf-42cd-9585-10e3ae511ab7]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5eb50a-c48a-4c10-b368-33c29e672762]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:51 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:51 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:02:51 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cc6c9-fabb-4bd9-9bf4-7ad8c9f33319]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]
Nov 18 16:02:52 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.
Nov 18 16:02:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1824b0e8-a859-4122-a6ee-8ed5a533d0a6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0df82f-9d31-4447-b192-8fc739a7b88a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:02:52 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:02:52 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49c232-4360-490d-ac5a-a994a6154df4]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:52 user nova-compute[74839]: WARNING nova.compute.manager [req-355126c0-6596-48a6-8d5b-a8741dcedab1 req-30f280d6-2590-4217-990c-c4dc427f38bf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 16:02:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23661306562336335', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661306562336335', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:02:51Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'pci_devices' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Object Instance<a7ca78a5-091b-4e44-9c63-e96881ffeddc> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:02:53 user nova-compute[74839]:   <uuid>a7ca78a5-091b-4e44-9c63-e96881ffeddc</uuid>
Nov 18 16:02:53 user nova-compute[74839]:   <name>instance-0000002d</name>
Nov 18 16:02:53 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:02:53 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:02:53 user nova-compute[74839]:   <metadata>
Nov 18 16:02:53 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:02:53 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:name>tempest-TestMinimumBasicScenario-server-1247292875</nova:name>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:02:51</nova:creationTime>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:02:53 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:02:53 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:owner>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:user uuid="f71eb7e6ae7f4f399d08eeb9ebc98097">tempest-TestMinimumBasicScenario-147307032-project-member</nova:user>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:project uuid="7eebaec30e6d43a7aa4ba5aa548d3954">tempest-TestMinimumBasicScenario-147307032</nova:project>
Nov 18 16:02:53 user nova-compute[74839]:       </nova:owner>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:root type="image" uuid="9ed71f53-7f85-48d3-9e6a-5c08a9807498"/>
Nov 18 16:02:53 user nova-compute[74839]:       <nova:ports>
Nov 18 16:02:53 user nova-compute[74839]:         <nova:port uuid="31296d0b-d5fa-4cb8-8292-7ddaf8855c99">
Nov 18 16:02:53 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 16:02:53 user nova-compute[74839]:         </nova:port>
Nov 18 16:02:53 user nova-compute[74839]:       </nova:ports>
Nov 18 16:02:53 user nova-compute[74839]:     </nova:instance>
Nov 18 16:02:53 user nova-compute[74839]:   </metadata>
Nov 18 16:02:53 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:02:53 user nova-compute[74839]:     <system>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="serial">a7ca78a5-091b-4e44-9c63-e96881ffeddc</entry>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="uuid">a7ca78a5-091b-4e44-9c63-e96881ffeddc</entry>
Nov 18 16:02:53 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:02:53 user nova-compute[74839]:     </system>
Nov 18 16:02:53 user nova-compute[74839]:   </sysinfo>
Nov 18 16:02:53 user nova-compute[74839]:   <os>
Nov 18 16:02:53 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:02:53 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:02:53 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:02:53 user nova-compute[74839]:   </os>
Nov 18 16:02:53 user nova-compute[74839]:   <features>
Nov 18 16:02:53 user nova-compute[74839]:     <acpi/>
Nov 18 16:02:53 user nova-compute[74839]:     <apic/>
Nov 18 16:02:53 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:02:53 user nova-compute[74839]:   </features>
Nov 18 16:02:53 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:02:53 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:02:53 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:02:53 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:02:53 user nova-compute[74839]:   </clock>
Nov 18 16:02:53 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:02:53 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:02:53 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:02:53 user nova-compute[74839]:   </cpu>
Nov 18 16:02:53 user nova-compute[74839]:   <devices>
Nov 18 16:02:53 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:02:53 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:02:53 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk"/>
Nov 18 16:02:53 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:02:53 user nova-compute[74839]:     </disk>
Nov 18 16:02:53 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:02:53 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:02:53 user nova-compute[74839]:       <source dev="/dev/sde"/>
Nov 18 16:02:53 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 16:02:53 user nova-compute[74839]:       <serial>f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1</serial>
Nov 18 16:02:53 user nova-compute[74839]:     </disk>
Nov 18 16:02:53 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:02:53 user nova-compute[74839]:       <mac address="fa:16:3e:47:d1:3d"/>
Nov 18 16:02:53 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:02:53 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:02:53 user nova-compute[74839]:       <target dev="tap31296d0b-d5"/>
Nov 18 16:02:53 user nova-compute[74839]:     </interface>
Nov 18 16:02:53 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:02:53 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/console.log" append="off"/>
Nov 18 16:02:53 user nova-compute[74839]:     </serial>
Nov 18 16:02:53 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:02:53 user nova-compute[74839]:     <video>
Nov 18 16:02:53 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:02:53 user nova-compute[74839]:     </video>
Nov 18 16:02:53 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:02:53 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:02:53 user nova-compute[74839]:     </rng>
Nov 18 16:02:53 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:02:53 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:02:53 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:02:53 user nova-compute[74839]:     </memballoon>
Nov 18 16:02:53 user nova-compute[74839]:   </devices>
Nov 18 16:02:53 user nova-compute[74839]: </domain>
Nov 18 16:02:53 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Object Instance<a7ca78a5-091b-4e44-9c63-e96881ffeddc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Cannot resize image /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'migration_context' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.objects.base [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Object Instance<a7ca78a5-091b-4e44-9c63-e96881ffeddc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:02:51Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG os_vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15fbbddc-f723-58f8-b53f-0e84267e5663', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31296d0b-d5, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31296d0b-d5, col_values=(('qos', UUID('e3c16909-ac61-4384-9ba6-a8b6103f32d5')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31296d0b-d5, col_values=(('external_ids', {'iface-id': '31296d0b-d5fa-4cb8-8292-7ddaf8855c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d1:3d', 'vm-uuid': 'a7ca78a5-091b-4e44-9c63-e96881ffeddc'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:02:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:53 user nova-compute[74839]: INFO os_vif [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5')
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:55 user nova-compute[74839]: WARNING nova.compute.manager [req-8741c658-3aae-4284-8000-d3e4dbd20a84 req-f5ba005d-c5c2-4477-9e6f-5ee4e123e51f service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state active and task_state reboot_started_hard.
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:02:57 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance rebooted successfully.
Nov 18 16:02:57 user nova-compute[74839]: DEBUG nova.compute.manager [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c5032d5b-1880-48d1-85b0-937080faa503 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.803s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:02:57 user nova-compute[74839]: DEBUG nova.compute.manager [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:02:57 user nova-compute[74839]: WARNING nova.compute.manager [req-512966d6-aaf1-4062-a9e9-077661e08a7f req-9ceee7b3-598d-4966-a2f4-b62ad70b5fdf service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state active and task_state None.
Nov 18 16:02:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:02:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:02:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:03:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:03:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:03:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:03:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.05868148803711GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance e62f7e86-92f9-4e29-8297-731c213237b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 574e14df-1ce8-4935-aa10-df480c4d01de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a7ca78a5-091b-4e44-9c63-e96881ffeddc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab1f1b6e-9a65-4325-9246-ead8add841db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:03:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:09 user nova-compute[74839]: INFO nova.compute.manager [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Detaching volume 5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:03:09 user nova-compute[74839]: INFO nova.virt.block_device [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Attempting to driver detach volume 5ad58280-c884-41f7-a5cf-e4a8ca579195 from mountpoint /dev/vdb
Nov 18 16:03:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Attempting to detach device vdb from instance e62f7e86-92f9-4e29-8297-731c213237b6 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:03:09 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:03:09 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:03:09 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:03:09 user nova-compute[74839]:   <serial>5ad58280-c884-41f7-a5cf-e4a8ca579195</serial>
Nov 18 16:03:09 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:03:09 user nova-compute[74839]: </disk>
Nov 18 16:03:09 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:03:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Successfully detached device vdb from instance e62f7e86-92f9-4e29-8297-731c213237b6 from the persistent domain config.
Nov 18 16:03:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e62f7e86-92f9-4e29-8297-731c213237b6 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:03:09 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:03:09 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:03:09 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:03:09 user nova-compute[74839]:   <serial>5ad58280-c884-41f7-a5cf-e4a8ca579195</serial>
Nov 18 16:03:09 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:03:09 user nova-compute[74839]: </disk>
Nov 18 16:03:09 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:03:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:03:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:03:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-changed-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG nova.compute.manager [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Refreshing instance network info cache due to event network-changed-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] Acquiring lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] Acquired lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:03:26 user nova-compute[74839]: DEBUG nova.network.neutron [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Refreshing network info cache for port cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updated VIF entry in instance network info cache for port cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updating instance_info_cache with network_info: [{"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-14a6c01e-b6c9-4a1b-94c8-48bfe75e8448 req-1425a3e3-b8eb-4b0d-8d23-a64b6c458ce9 service nova] Releasing lock "refresh_cache-ab1f1b6e-9a65-4325-9246-ead8add841db" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:27 user nova-compute[74839]: INFO nova.compute.manager [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Terminating instance
Nov 18 16:03:27 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Instance destroyed successfully.
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.objects.instance [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid ab1f1b6e-9a65-4325-9246-ead8add841db {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-668562598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-668562598',id=46,image_ref='3f348665-3fdd-49ed-9f01-a10eeaa3832c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJPEavGbabepGplaYLDbY/2DrJaluWGZUru4GWy45YexK2tY7oID+guqkVMHx3Vd4GVkr9P44maXsCZILBiP0+wHK/07lArcsDeAlM5LU/GADVM6gzXcYsIvXeqzXsFRA==',key_name='tempest-keypair-762813055',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-0u1ny9a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1298499824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:01:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab1f1b6e-9a65-4325-9246-ead8add841db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "address": "fa:16:3e:d2:f9:2e", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5fedf1-ff", "ovs_interfaceid": "cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_vif [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5fedf1-ff, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d9a1ab2-af86-46ff-b413-f96445a9d243) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:28 user nova-compute[74839]: INFO os_vif [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:f9:2e,bridge_name='br-int',has_traffic_filtering=True,id=cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5fedf1-ff')
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbpKgoaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:03:28 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f2602-6031-42fe-a0fc-eec9b8e5f830]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:03:28 user nova-compute[74839]: No targets found.
Nov 18 16:03:28 user nova-compute[74839]: iSNS:
Nov 18 16:03:28 user nova-compute[74839]: No targets found.
Nov 18 16:03:28 user nova-compute[74839]: STATIC:
Nov 18 16:03:28 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f
Nov 18 16:03:28 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:28 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:28 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:03:28 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:28 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:28 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f
Nov 18 16:03:28 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:28 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:28 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:03:28 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:28 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:28 user nova-compute[74839]: FIRMWARE:
Nov 18 16:03:28 user nova-compute[74839]: No targets found.
Nov 18 16:03:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:03:28 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:03:28 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9a4243-e8b1-49e6-b53c-52f9a27feb5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0244904-4e33-46cf-8c87-4affcdf35d9e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:03:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f (non-flash)
Nov 18 16:03:28 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:03:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48023feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[af585025-0035-4c0b-a751-49868bf1be97]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf57d39-d226-4cde-a6e8-9269aebf7c99]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf6ed65-0723-4a3b-b597-a4ae2a2201fd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b4c1be-d54d-45f8-98ea-533b5cf34344]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf60ccf99-ed0cfc17bd26afc1', '/dev/disk/by-id/scsi-26564306366633137', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f60ccf99') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f7f58-ff2b-47ed-ac71-fb296115a87a]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b966a9-9225-4685-881d-799e7fb255d3]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d6b7e-fb93-4680-83e4-5106addee0e2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260]
Nov 18 16:03:28 user nova-compute[74839]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f, portal: 172.16.0.220,3260] successful.
Nov 18 16:03:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bee2709c-d476-4afc-92a6-ccc8423bea9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1533b17d-a04b-4d9a-816e-5e5239d2e152]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (331ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:03:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Deleting instance files /opt/stack/data/nova/instances/ab1f1b6e-9a65-4325-9246-ead8add841db_del
Nov 18 16:03:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Deletion of /opt/stack/data/nova/instances/ab1f1b6e-9a65-4325-9246-ead8add841db_del complete
Nov 18 16:03:28 user nova-compute[74839]: INFO nova.compute.manager [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-unplugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] No waiting events found dispatching network-vif-unplugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-unplugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Acquiring lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] No waiting events found dispatching network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:03:28 user nova-compute[74839]: WARNING nova.compute.manager [req-6c766628-32a6-45b0-a8db-7dc33c580cdb req-37ed3173-159f-469d-bc21-31e3078010ad service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received unexpected event network-vif-plugged-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 for instance with vm_state active and task_state deleting.
Nov 18 16:03:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:03:29 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Took 0.83 seconds to deallocate network for instance.
Nov 18 16:03:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-e4c5889b-0113-47d7-aa1c-37a538a484bb req-c8c082d9-e639-48ae-9140-422b9a650429 service nova] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Received event network-vif-deleted-cf5fedf1-ffe8-4eb7-ba0a-9754a75e0939 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:03:29 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e62f7e86-92f9-4e29-8297-731c213237b6 is timed out.
Nov 18 16:03:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Successfully detached device vdb from instance e62f7e86-92f9-4e29-8297-731c213237b6 from the live domain config.
Nov 18 16:03:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uFilZtBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:03:29 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[191bfcaa-a259-4e37-948a-fe3825eba2df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:03:29 user nova-compute[74839]: No targets found.
Nov 18 16:03:29 user nova-compute[74839]: iSNS:
Nov 18 16:03:29 user nova-compute[74839]: No targets found.
Nov 18 16:03:29 user nova-compute[74839]: STATIC:
Nov 18 16:03:29 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195
Nov 18 16:03:29 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:29 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:29 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f
Nov 18 16:03:29 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:29 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:29 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:03:29 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:03:29 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:03:29 user nova-compute[74839]: FIRMWARE:
Nov 18 16:03:29 user nova-compute[74839]: No targets found.
Nov 18 16:03:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:03:29 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:03:29 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465df18-ef3e-46d7-bd59-b56cda9bcfff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddacc2fd-ac05-4c74-a5f9-72a00295b726]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:03:29 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:03:29 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:03:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:03:29 user nova-compute[74839]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 (non-flash)
Nov 18 16:03:29 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:03:29 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c54f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d14aea-f2cf-46a2-83c0-da4d95470059]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b9a09-32a1-4562-b43f-67cc91210920]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5684c6ef-603c-4a03-a52c-00db9a034b24]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[55520594-0e21-4515-93ea-b82b8ba15d61]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ae681-ccc2-4507-a92f-9618be8e1000]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[76abc228-2a1a-4522-b53a-bfda9b92844d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260]
Nov 18 16:03:30 user nova-compute[74839]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195, portal: 172.16.0.220,3260] successful.
Nov 18 16:03:30 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:03:30 user nova-compute[74839]: INFO nova.compute.manager [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 16:03:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab1f1b6e-9a65-4325-9246-ead8add841db] Deleting volume: bee2709c-d476-4afc-92a6-ccc8423bea9f {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad58280-c884-41f7-a5cf-e4a8ca579195 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f81a48-5f51-44b0-9284-9b495a406ba9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] <== disconnect_volume: return (313ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:30 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance ab1f1b6e-9a65-4325-9246-ead8add841db
Nov 18 16:03:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-1f46bb82-e3d1-4b58-bb5e-745caefd2003 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab1f1b6e-9a65-4325-9246-ead8add841db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.241s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:31 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'flavor' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:03:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6f87cd1b-ec33-4d1b-ba5d-ce100be06209 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:03:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:03:59 user nova-compute[74839]: INFO nova.compute.manager [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Terminating instance
Nov 18 16:03:59 user nova-compute[74839]: DEBUG nova.compute.manager [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:03:59 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.compute.manager [req-224ca81e-eff1-463d-9128-a3f250ac7368 req-ecec78f1-af99-4775-afc7-298aaaf3e60e service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Instance destroyed successfully.
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.objects.instance [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lazy-loading 'resources' on Instance uuid e62f7e86-92f9-4e29-8297-731c213237b6 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:56:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1592452155',display_name='tempest-ServerStableDeviceRescueTest-server-1592452155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1592452155',id=42,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjAYH8kg1G2Y/KPkecyGO/mDFmv5bsIUFUmHAnULqcx0q/Mccqm1Fqz6KKm5IQ5f1grMNfJOXpzoHchDksQeUvyNuV3gFR/fY9IBLkCy5698yjmKbtnqyz6Nc0xVimEeg==',key_name='tempest-keypair-686167618',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfd4b53b959f420aaa99aed52962cf44',ramdisk_id='',reservation_id='r-zvvcbwmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1600041166',owner_user_name='tempest-ServerStableDeviceRescueTest-1600041166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90da6d5104b14a1d8cc277239c6ffe44',uuid=e62f7e86-92f9-4e29-8297-731c213237b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converting VIF {"id": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "address": "fa:16:3e:b2:48:96", "network": {"id": "07896a35-0f86-404d-b57e-c4e578d0aad4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1239645390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd4b53b959f420aaa99aed52962cf44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294162fa-bd", "ovs_interfaceid": "294162fa-bd9d-43ed-a388-14e9aa54a8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG os_vif [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap294162fa-bd, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=545f625c-4c8d-4e52-8da0-515c5073fb57) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:00 user nova-compute[74839]: INFO os_vif [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:48:96,bridge_name='br-int',has_traffic_filtering=True,id=294162fa-bd9d-43ed-a388-14e9aa54a8bd,network=Network(07896a35-0f86-404d-b57e-c4e578d0aad4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294162fa-bd')
Nov 18 16:04:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Deleting instance files /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6_del
Nov 18 16:04:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Deletion of /opt/stack/data/nova/instances/e62f7e86-92f9-4e29-8297-731c213237b6_del complete
Nov 18 16:04:00 user nova-compute[74839]: INFO nova.compute.manager [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 16:04:00 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:04:00 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:04:01 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Took 0.99 seconds to deallocate network for instance.
Nov 18 16:04:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:04:01 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 574e14df-1ce8-4935-aa10-df480c4d01de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:04:02 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Deleted allocations for instance e62f7e86-92f9-4e29-8297-731c213237b6
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-709d1427-fd38-4fbd-b968-3a8d3a62f160 tempest-ServerStableDeviceRescueTest-1600041166 tempest-ServerStableDeviceRescueTest-1600041166-project-member] Lock "e62f7e86-92f9-4e29-8297-731c213237b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:02 user nova-compute[74839]: WARNING nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state deleted and task_state None.
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:02 user nova-compute[74839]: WARNING nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state deleted and task_state None.
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:02 user nova-compute[74839]: WARNING nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state deleted and task_state None.
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:02 user nova-compute[74839]: WARNING nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-unplugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state deleted and task_state None.
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Acquiring lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] Lock "e62f7e86-92f9-4e29-8297-731c213237b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] No waiting events found dispatching network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:02 user nova-compute[74839]: WARNING nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received unexpected event network-vif-plugged-294162fa-bd9d-43ed-a388-14e9aa54a8bd for instance with vm_state deleted and task_state None.
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-8ff94860-29b9-4abc-af5f-ba9d1376b0f2 req-4f7c9398-89a9-4262-b6bf-e67ed33f90a6 service nova] [instance: e62f7e86-92f9-4e29-8297-731c213237b6] Received event network-vif-deleted-294162fa-bd9d-43ed-a388-14e9aa54a8bd {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [{"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-574e14df-1ce8-4935-aa10-df480c4d01de" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:02 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:04:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:04:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.182483673095703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 574e14df-1ce8-4935-aa10-df480c4d01de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a7ca78a5-091b-4e44-9c63-e96881ffeddc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:04:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:20 user nova-compute[74839]: INFO nova.compute.manager [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Terminating instance
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-unplugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] No waiting events found dispatching network-vif-unplugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-11a55938-62a0-4869-b7ab-7968c471d93f req-797e5ac4-084b-4271-a135-774dca681b1b service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-unplugged-61cebc1a-fc39-46ce-b716-16177128c36a for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Instance destroyed successfully.
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.objects.instance [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid 574e14df-1ce8-4935-aa10-df480c4d01de {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1885786787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1885786787',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm4cDQfNbAS3WuAwvGblLU3ap4ieCAkM7FG5wq2S5xCZZ9wzfYwREgJxvnO/5ysz6Agbf5dR9IvCfxnfc6ZjqZPsa3mMrHvWdNJtiQqqKKDXE9/19A+bYo2D/KBZ4jujg==',key_name='tempest-keypair-2117530852',keypairs=<?>,launch_index=0,launched_at=2023-11-18T15:59:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-qmma6j4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T15:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=574e14df-1ce8-4935-aa10-df480c4d01de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "61cebc1a-fc39-46ce-b716-16177128c36a", "address": "fa:16:3e:94:c0:61", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cebc1a-fc", "ovs_interfaceid": "61cebc1a-fc39-46ce-b716-16177128c36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_vif [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61cebc1a-fc, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=234c081f-0155-4b63-9e4b-c1ad1706aaad) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:20 user nova-compute[74839]: INFO os_vif [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:c0:61,bridge_name='br-int',has_traffic_filtering=True,id=61cebc1a-fc39-46ce-b716-16177128c36a,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cebc1a-fc')
Nov 18 16:04:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEqloOck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:04:20 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264cc0d-d4cf-4e54-b2f1-90b38ef6bdf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:04:20 user nova-compute[74839]: No targets found.
Nov 18 16:04:20 user nova-compute[74839]: iSNS:
Nov 18 16:04:20 user nova-compute[74839]: No targets found.
Nov 18 16:04:20 user nova-compute[74839]: STATIC:
Nov 18 16:04:20 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f
Nov 18 16:04:20 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:04:20 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:04:20 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:04:20 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:04:20 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:04:20 user nova-compute[74839]: FIRMWARE:
Nov 18 16:04:20 user nova-compute[74839]: No targets found.
Nov 18 16:04:20 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:04:20 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:04:20 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40995e7-c841-4c40-8de0-d36a1d5d0bfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f632d-7765-4cd4-84d8-bcbf5584b3ff]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:04:20 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:04:20 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f (non-flash)
Nov 18 16:04:20 user nova-compute[74839]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:04:20 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd498179ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4d73b-66d0-4a69-b62a-9883a4e85e11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb67ea51-2304-4ee6-b884-b895a12cb4d1]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ffa9f-f55a-4b94-8c9c-ec2827e3d913]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c403f-bccc-4242-a4cd-428af34fa108]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23965346434613464', '/dev/disk/by-id/scsi-1SCST_BIOa54baf7-9e4d4a4d5043dfd9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a54baf7') {{(pid=85739) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205b708-0645-4c37-89a6-e469bc1f167a]: (4, None) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:04:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d762f35-63e0-4a0d-87e1-03a69a859d7b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[831893df-13a6-48fa-8edb-44fec8e0e6a4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260]
Nov 18 16:04:21 user nova-compute[74839]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f, portal: 172.16.0.220,3260] successful.
Nov 18 16:04:21 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5770fed9-cc91-44cc-94cc-6d8828e5020f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[651665bf-68f3-45d3-8912-3406cfc70b69]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (309ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:04:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Deleting instance files /opt/stack/data/nova/instances/574e14df-1ce8-4935-aa10-df480c4d01de_del
Nov 18 16:04:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Deletion of /opt/stack/data/nova/instances/574e14df-1ce8-4935-aa10-df480c4d01de_del complete
Nov 18 16:04:21 user nova-compute[74839]: INFO nova.compute.manager [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 18 16:04:21 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:04:21 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:04:21 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Took 0.70 seconds to deallocate network for instance.
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] Acquiring lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] Lock "574e14df-1ce8-4935-aa10-df480c4d01de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] No waiting events found dispatching network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:04:22 user nova-compute[74839]: WARNING nova.compute.manager [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received unexpected event network-vif-plugged-61cebc1a-fc39-46ce-b716-16177128c36a for instance with vm_state active and task_state deleting.
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.compute.manager [req-d54a5ace-1d7a-426d-bb1e-2c4a08efd6ce req-9af538e1-0925-4c6a-b735-038a1b61fbb7 service nova] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Received event network-vif-deleted-61cebc1a-fc39-46ce-b716-16177128c36a {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:22 user nova-compute[74839]: INFO nova.compute.manager [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Took 0.76 seconds to detach 1 volumes for instance.
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: 574e14df-1ce8-4935-aa10-df480c4d01de] Deleting volume: 5770fed9-cc91-44cc-94cc-6d8828e5020f {{(pid=74839) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:04:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:22 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance 574e14df-1ce8-4935-aa10-df480c4d01de
Nov 18 16:04:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cfbdd11f-c6bc-4c58-aa83-75815b4ae348 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "574e14df-1ce8-4935-aa10-df480c4d01de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:04:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:04:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:04:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing instance network info cache due to event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated VIF entry in instance network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG nova.network.neutron [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:04:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-123c54f3-dacd-47be-a9f0-9f666618a988 req-a09f8433-ba6b-496c-92aa-a550a232280e service nova] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:04:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:04:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:04:43 user nova-compute[74839]: INFO nova.compute.manager [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Detaching volume f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:04:43 user nova-compute[74839]: INFO nova.virt.block_device [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Attempting to driver detach volume f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 from mountpoint /dev/vdb
Nov 18 16:04:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Attempting to detach device vdb from instance a7ca78a5-091b-4e44-9c63-e96881ffeddc from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:04:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:04:43 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:04:43 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 16:04:43 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:04:43 user nova-compute[74839]:   <serial>f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1</serial>
Nov 18 16:04:43 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 16:04:43 user nova-compute[74839]: </disk>
Nov 18 16:04:43 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:04:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully detached device vdb from instance a7ca78a5-091b-4e44-9c63-e96881ffeddc from the persistent domain config.
Nov 18 16:04:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7ca78a5-091b-4e44-9c63-e96881ffeddc from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:04:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:04:43 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:04:43 user nova-compute[74839]:   <source dev="/dev/sde"/>
Nov 18 16:04:43 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:04:43 user nova-compute[74839]:   <serial>f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1</serial>
Nov 18 16:04:43 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 16:04:43 user nova-compute[74839]: </disk>
Nov 18 16:04:43 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:04:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG nova.compute.manager [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing instance network info cache due to event network-changed-31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Refreshing network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated VIF entry in instance network info cache for port 31296d0b-d5fa-4cb8-8292-7ddaf8855c99. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG nova.network.neutron [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:04:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7569a61f-38b8-4314-8ca6-feaef20586bd req-7c38e021-4e37-464b-9f66-0807150909fe service nova] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:04:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:04:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:01 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:05:03 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7ca78a5-091b-4e44-9c63-e96881ffeddc is timed out.
Nov 18 16:05:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully detached device vdb from instance a7ca78a5-091b-4e44-9c63-e96881ffeddc from the live domain config.
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTsVgQcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:05:03 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e36d0c-046f-4ad6-b122-6259de78caff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:05:03 user nova-compute[74839]: No targets found.
Nov 18 16:05:03 user nova-compute[74839]: iSNS:
Nov 18 16:05:03 user nova-compute[74839]: No targets found.
Nov 18 16:05:03 user nova-compute[74839]: STATIC:
Nov 18 16:05:03 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1
Nov 18 16:05:03 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:05:03 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:05:03 user nova-compute[74839]: FIRMWARE:
Nov 18 16:05:03 user nova-compute[74839]: No targets found.
Nov 18 16:05:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:05:03 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:05:03 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561525a-b491-441b-97d1-842423423f94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f63365-c47e-45aa-8497-9df70506452d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:05:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 (non-flash)
Nov 18 16:05:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd480739240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bf5b80-2a6d-4260-a48d-1fce4b8638e9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[963cb9d6-06ae-45f9-a82b-1c7311d03f6c]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcacb60-f77a-4333-9590-32f12767fd40]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95a228-692a-4bb8-a6d4-db9e29fc3a92]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992093a-fdfc-4d3f-bd48-494fe4194c68]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bda89b-8348-46f9-9005-3d30e467c38c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260]
Nov 18 16:05:03 user nova-compute[74839]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1, portal: 172.16.0.220,3260] successful.
Nov 18 16:05:03 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1eb2653-56af-4a6a-ab9b-de0c22aa0bf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307c791-6782-4899-9a43-b697165cc003]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== disconnect_volume: return (287ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [{"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-a7ca78a5-091b-4e44-9c63-e96881ffeddc" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:03 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:05:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.180667877197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-29f86880-3338-4434-977c-d4cfdac4522e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance a7ca78a5-091b-4e44-9c63-e96881ffeddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:05:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:05:05 user nova-compute[74839]: INFO nova.compute.claims [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Claim successful on node user
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:05:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:05:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:05:05 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Creating image(s)
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.policy [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2c0abdcb59a49a5b5aae8f0ef925f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae89917b5d41f5bc1216f055dc263d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk 1073741824" returned: 0 in 0.068s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.202s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Cannot resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Ensure instance console log exists: /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Successfully created port: 5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Successfully updated port: 5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-changed-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Refreshing instance network info cache due to event network-changed-5982d76d-b425-4dc7-acd7-d2621f24f57e. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance network_info: |[{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.neutron [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Refreshing network info cache for port 5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start _get_guest_xml network_info=[{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:05:07 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:07 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'pci_devices' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:05:07 user nova-compute[74839]:   <uuid>081bc305-1c06-49b8-8520-a1d89be6af90</uuid>
Nov 18 16:05:07 user nova-compute[74839]:   <name>instance-0000002f</name>
Nov 18 16:05:07 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:05:07 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:05:07 user nova-compute[74839]:   <metadata>
Nov 18 16:05:07 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:05:07 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeTestJSON-server-1557433728</nova:name>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:05:07</nova:creationTime>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:05:07 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:05:07 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:owner>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:user uuid="d2c0abdcb59a49a5b5aae8f0ef925f27">tempest-AttachVolumeTestJSON-689484882-project-member</nova:user>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:project uuid="39ae89917b5d41f5bc1216f055dc263d">tempest-AttachVolumeTestJSON-689484882</nova:project>
Nov 18 16:05:07 user nova-compute[74839]:       </nova:owner>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:05:07 user nova-compute[74839]:       <nova:ports>
Nov 18 16:05:07 user nova-compute[74839]:         <nova:port uuid="5982d76d-b425-4dc7-acd7-d2621f24f57e">
Nov 18 16:05:07 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 16:05:07 user nova-compute[74839]:         </nova:port>
Nov 18 16:05:07 user nova-compute[74839]:       </nova:ports>
Nov 18 16:05:07 user nova-compute[74839]:     </nova:instance>
Nov 18 16:05:07 user nova-compute[74839]:   </metadata>
Nov 18 16:05:07 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:05:07 user nova-compute[74839]:     <system>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="serial">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="uuid">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:05:07 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:05:07 user nova-compute[74839]:     </system>
Nov 18 16:05:07 user nova-compute[74839]:   </sysinfo>
Nov 18 16:05:07 user nova-compute[74839]:   <os>
Nov 18 16:05:07 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:05:07 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:05:07 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:05:07 user nova-compute[74839]:   </os>
Nov 18 16:05:07 user nova-compute[74839]:   <features>
Nov 18 16:05:07 user nova-compute[74839]:     <acpi/>
Nov 18 16:05:07 user nova-compute[74839]:     <apic/>
Nov 18 16:05:07 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:05:07 user nova-compute[74839]:   </features>
Nov 18 16:05:07 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:05:07 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:05:07 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:05:07 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:05:07 user nova-compute[74839]:   </clock>
Nov 18 16:05:07 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:05:07 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:05:07 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:05:07 user nova-compute[74839]:   </cpu>
Nov 18 16:05:07 user nova-compute[74839]:   <devices>
Nov 18 16:05:07 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:05:07 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:05:07 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk"/>
Nov 18 16:05:07 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:05:07 user nova-compute[74839]:     </disk>
Nov 18 16:05:07 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:05:07 user nova-compute[74839]:       <mac address="fa:16:3e:fd:02:fb"/>
Nov 18 16:05:07 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:05:07 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:05:07 user nova-compute[74839]:       <target dev="tap5982d76d-b4"/>
Nov 18 16:05:07 user nova-compute[74839]:     </interface>
Nov 18 16:05:07 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:05:07 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/console.log" append="off"/>
Nov 18 16:05:07 user nova-compute[74839]:     </serial>
Nov 18 16:05:07 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:05:07 user nova-compute[74839]:     <video>
Nov 18 16:05:07 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:05:07 user nova-compute[74839]:     </video>
Nov 18 16:05:07 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:05:07 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:05:07 user nova-compute[74839]:     </rng>
Nov 18 16:05:07 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:05:07 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:05:07 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:05:07 user nova-compute[74839]:     </memballoon>
Nov 18 16:05:07 user nova-compute[74839]:   </devices>
Nov 18 16:05:07 user nova-compute[74839]: </domain>
Nov 18 16:05:07 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG os_vif [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38ff6ea8-13c7-5e86-8aab-d43756053a54', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5982d76d-b4, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5982d76d-b4, col_values=(('qos', UUID('1e118d76-936e-4fb1-8a20-04906dd0df9c')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5982d76d-b4, col_values=(('external_ids', {'iface-id': '5982d76d-b425-4dc7-acd7-d2621f24f57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:02:fb', 'vm-uuid': '081bc305-1c06-49b8-8520-a1d89be6af90'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:07 user nova-compute[74839]: INFO os_vif [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:05:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:05:07 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No VIF found with MAC fa:16:3e:fd:02:fb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:05:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated VIF entry in instance network info cache for port 5982d76d-b425-4dc7-acd7-d2621f24f57e. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:05:08 user nova-compute[74839]: DEBUG nova.network.neutron [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-16f838b2-3838-4312-aa7c-adc072ee8504 req-ddd0039d-6ffd-4256-b725-f6b659497553 service nova] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:05:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:09 user nova-compute[74839]: WARNING nova.compute.manager [req-ba5c3eed-ae0c-4b3f-8fe3-f90e2a7034d0 req-75daae6f-db14-4ab0-9512-bca9358f2779 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state building and task_state spawning.
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:05:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance spawned successfully.
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:11 user nova-compute[74839]: INFO nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:05:11 user nova-compute[74839]: INFO nova.compute.manager [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Took 6.08 seconds to build instance.
Nov 18 16:05:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f67aa296-f32b-4d14-a1a7-e9424ae6c7d8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.180s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:11 user nova-compute[74839]: WARNING nova.compute.manager [req-72d41957-b177-457a-8153-a6539404c3df req-018b1cb2-f758-4cb7-a7a6-5a1fcd7bae24 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state active and task_state None.
Nov 18 16:05:12 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:17 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:18 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:05:18 user nova-compute[74839]: INFO nova.compute.claims [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Claim successful on node user
Nov 18 16:05:18 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:05:19 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.policy [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:05:19 user nova-compute[74839]: INFO nova.virt.block_device [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Booting with volume 6e33e344-4ffc-4252-9667-01573d718c59 at /dev/vda
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.utils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a14f4-9989-4eeb-98fe-281567eecfaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d6131-e56c-419a-8232-60824c61b5f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[90161e73-e75c-4c81-92f2-c248038fc765]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ec3a7e-28e9-4cd4-a742-15f81edc8836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:05:19 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:05:19 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71444e62-cad4-47bc-9f9c-db17043ca5d2]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG os_brick.utils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating existing volume attachment record: 34aa7886-34a1-45c7-a37e-e508e793b56b {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:05:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Successfully created port: 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Successfully updated port: 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-changed-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.compute.manager [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Refreshing instance network info cache due to event network-changed-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] Acquiring lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating instance_info_cache with network_info: [{"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Instance network_info: |[{"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] Acquired lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:05:20 user nova-compute[74839]: DEBUG nova.network.neutron [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Refreshing network info cache for port 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:05:21 user nova-compute[74839]: DEBUG nova.network.neutron [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updated VIF entry in instance network info cache for port 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:05:21 user nova-compute[74839]: DEBUG nova.network.neutron [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating instance_info_cache with network_info: [{"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-27ea348a-3977-4841-a3dc-cf4e6c16ed41 req-ea8f3b19-cd03-4d10-99dd-d1ff62008899 service nova] Releasing lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:05:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:05:24 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Creating image(s)
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Ensure instance console log exists: /opt/stack/data/nova/instances/dadd264c-85f2-4dfa-910b-da35c45450dd/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Start _get_guest_xml network_info=[{"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '34aa7886-34a1-45c7-a37e-e508e793b56b', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dadd264c-85f2-4dfa-910b-da35c45450dd', 'attached_at': '', 'detached_at': '', 'volume_id': '6e33e344-4ffc-4252-9667-01573d718c59', 'serial': '6e33e344-4ffc-4252-9667-01573d718c59'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:05:24 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:24 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:05:24 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:05:24 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:05:24 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de5db22-84f8-49e1-adfc-b580d60eced3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:05:24 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8820c96-2187-43b2-9f00-abb97d5b75df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59] added
Nov 18 16:05:24 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dbeeba-a898-4e8f-bd9b-14e7733b0e17]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6261909-c956-4758-8854-481fc318bd71]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBsrpcdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBsrpcdg" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8739a628-9d3e-46d0-adb6-c8747166d24a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBsrpcdg'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670971e-1341-4008-a7e6-27a69f7baf88]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[795a7c94-92c9-4afb-b0fb-73c257f3b825]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:05:24 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:05:24 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:05:24 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:05:24 user nova-compute[74839]: 
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c828f80-76d9-450a-9fe3-0babddfb33a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]
Nov 18 16:05:24 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.
Nov 18 16:05:24 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c61465-80a0-4aaf-9f60-e9bbae8dd146]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:05:24 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcf3645-e048-400f-b304-b00947ebc637]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:05:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:05:25 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[67238212-293a-47d6-8e07-9fbb7cbf8366]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:05:25 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23332326638363866', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332326638363866', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1217726568',display_name='tempest-TestVolumeBootPattern-server-1217726568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1217726568',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-jjewmpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:05:19Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=dadd264c-85f2-4dfa-910b-da35c45450dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid dadd264c-85f2-4dfa-910b-da35c45450dd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:05:26 user nova-compute[74839]:   <uuid>dadd264c-85f2-4dfa-910b-da35c45450dd</uuid>
Nov 18 16:05:26 user nova-compute[74839]:   <name>instance-00000030</name>
Nov 18 16:05:26 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:05:26 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:05:26 user nova-compute[74839]:   <metadata>
Nov 18 16:05:26 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:05:26 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:05:26 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-server-1217726568</nova:name>
Nov 18 16:05:26 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:05:24</nova:creationTime>
Nov 18 16:05:26 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:05:26 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:05:26 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:05:26 user nova-compute[74839]:       <nova:owner>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 16:05:26 user nova-compute[74839]:       </nova:owner>
Nov 18 16:05:26 user nova-compute[74839]:       <nova:ports>
Nov 18 16:05:26 user nova-compute[74839]:         <nova:port uuid="3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb">
Nov 18 16:05:26 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 16:05:26 user nova-compute[74839]:         </nova:port>
Nov 18 16:05:26 user nova-compute[74839]:       </nova:ports>
Nov 18 16:05:26 user nova-compute[74839]:     </nova:instance>
Nov 18 16:05:26 user nova-compute[74839]:   </metadata>
Nov 18 16:05:26 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:05:26 user nova-compute[74839]:     <system>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="serial">dadd264c-85f2-4dfa-910b-da35c45450dd</entry>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="uuid">dadd264c-85f2-4dfa-910b-da35c45450dd</entry>
Nov 18 16:05:26 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:05:26 user nova-compute[74839]:     </system>
Nov 18 16:05:26 user nova-compute[74839]:   </sysinfo>
Nov 18 16:05:26 user nova-compute[74839]:   <os>
Nov 18 16:05:26 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:05:26 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:05:26 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:05:26 user nova-compute[74839]:   </os>
Nov 18 16:05:26 user nova-compute[74839]:   <features>
Nov 18 16:05:26 user nova-compute[74839]:     <acpi/>
Nov 18 16:05:26 user nova-compute[74839]:     <apic/>
Nov 18 16:05:26 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:05:26 user nova-compute[74839]:   </features>
Nov 18 16:05:26 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:05:26 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:05:26 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:05:26 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:05:26 user nova-compute[74839]:   </clock>
Nov 18 16:05:26 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:05:26 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:05:26 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:05:26 user nova-compute[74839]:   </cpu>
Nov 18 16:05:26 user nova-compute[74839]:   <devices>
Nov 18 16:05:26 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:05:26 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:05:26 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 16:05:26 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:05:26 user nova-compute[74839]:       <serial>6e33e344-4ffc-4252-9667-01573d718c59</serial>
Nov 18 16:05:26 user nova-compute[74839]:     </disk>
Nov 18 16:05:26 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:05:26 user nova-compute[74839]:       <mac address="fa:16:3e:62:a5:88"/>
Nov 18 16:05:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:05:26 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:05:26 user nova-compute[74839]:       <target dev="tap3ff7b3c0-5f"/>
Nov 18 16:05:26 user nova-compute[74839]:     </interface>
Nov 18 16:05:26 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:05:26 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/dadd264c-85f2-4dfa-910b-da35c45450dd/console.log" append="off"/>
Nov 18 16:05:26 user nova-compute[74839]:     </serial>
Nov 18 16:05:26 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:05:26 user nova-compute[74839]:     <video>
Nov 18 16:05:26 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:05:26 user nova-compute[74839]:     </video>
Nov 18 16:05:26 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:05:26 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:05:26 user nova-compute[74839]:     </rng>
Nov 18 16:05:26 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:05:26 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:05:26 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:05:26 user nova-compute[74839]:     </memballoon>
Nov 18 16:05:26 user nova-compute[74839]:   </devices>
Nov 18 16:05:26 user nova-compute[74839]: </domain>
Nov 18 16:05:26 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1217726568',display_name='tempest-TestVolumeBootPattern-server-1217726568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1217726568',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-jjewmpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:05:19Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=dadd264c-85f2-4dfa-910b-da35c45450dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG os_vif [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4c7a04b-3e73-5d92-8565-5a50c2e52012', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ff7b3c0-5f, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ff7b3c0-5f, col_values=(('qos', UUID('4c5d6d8e-a5c4-47e5-8509-e0b58cb93b49')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ff7b3c0-5f, col_values=(('external_ids', {'iface-id': '3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a5:88', 'vm-uuid': 'dadd264c-85f2-4dfa-910b-da35c45450dd'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:26 user nova-compute[74839]: INFO os_vif [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f')
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:05:26 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:62:a5:88, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] No waiting events found dispatching network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:27 user nova-compute[74839]: WARNING nova.compute.manager [req-a439980d-b5eb-4a30-a9d1-8dfda30fbd24 req-60d67f2a-a050-4284-b1b0-0880d7263123 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received unexpected event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb for instance with vm_state building and task_state spawning.
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:05:29 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Instance spawned successfully.
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:05:29 user nova-compute[74839]: INFO nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:29 user nova-compute[74839]: DEBUG nova.compute.manager [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] No waiting events found dispatching network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:29 user nova-compute[74839]: WARNING nova.compute.manager [req-40c05051-5bc4-4e20-991e-1f0f47335adf req-53207810-6cab-4947-b1b0-18da05e1f879 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received unexpected event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb for instance with vm_state building and task_state spawning.
Nov 18 16:05:29 user nova-compute[74839]: INFO nova.compute.manager [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Took 10.98 seconds to build instance.
Nov 18 16:05:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ec356c8c-0607-4014-9763-6fa8320c8e17 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.065s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:35 user nova-compute[74839]: INFO nova.compute.manager [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Terminating instance
Nov 18 16:05:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.compute.manager [req-e1b32d32-d962-48ee-b148-ca9c5383f62d req-1ad04dfd-b000-4154-875b-727d038527a6 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-unplugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:05:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Instance destroyed successfully.
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'resources' on Instance uuid a7ca78a5-091b-4e44-9c63-e96881ffeddc {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1247292875',display_name='tempest-TestMinimumBasicScenario-server-1247292875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1247292875',id=45,image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2czWKG2wXQFgpQyV11oNOmOheUkwTyTmjM5e1LPO1DYfgH0vI8oQaBbo68jeywG7Hpa3ihYGnin4WkH97nMuHzymkRyCW85cFEPn6zf8T9fEkQ1Cu/ARq0gxonlNb6jA==',key_name='tempest-TestMinimumBasicScenario-943389357',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-2lz518v1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9ed71f53-7f85-48d3-9e6a-5c08a9807498',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:02:57Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=a7ca78a5-091b-4e44-9c63-e96881ffeddc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "address": "fa:16:3e:47:d1:3d", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31296d0b-d5", "ovs_interfaceid": "31296d0b-d5fa-4cb8-8292-7ddaf8855c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG os_vif [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31296d0b-d5, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3c16909-ac61-4384-9ba6-a8b6103f32d5) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:05:36 user nova-compute[74839]: INFO os_vif [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d1:3d,bridge_name='br-int',has_traffic_filtering=True,id=31296d0b-d5fa-4cb8-8292-7ddaf8855c99,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31296d0b-d5')
Nov 18 16:05:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Deleting instance files /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc_del
Nov 18 16:05:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Deletion of /opt/stack/data/nova/instances/a7ca78a5-091b-4e44-9c63-e96881ffeddc_del complete
Nov 18 16:05:36 user nova-compute[74839]: INFO nova.compute.manager [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 18 16:05:36 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:05:36 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:05:37 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Took 0.40 seconds to deallocate network for instance.
Nov 18 16:05:37 user nova-compute[74839]: DEBUG nova.compute.manager [req-a5c81c48-c0b9-48fa-9c90-8ffccfcfb3f3 req-278b1a5e-adef-4d52-8874-dbd9673fa2c9 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-deleted-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:05:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:37 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Deleted allocations for instance a7ca78a5-091b-4e44-9c63-e96881ffeddc
Nov 18 16:05:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fe7c8d73-5f2c-48a1-8318-3b18864e550e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:05:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] Acquiring lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:05:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:05:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] Lock "a7ca78a5-091b-4e44-9c63-e96881ffeddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:05:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] No waiting events found dispatching network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:05:38 user nova-compute[74839]: WARNING nova.compute.manager [req-9f3910b9-340f-4257-ad19-28f28b2c1981 req-510ae0bf-1fef-4259-b614-41b767b137f8 service nova] [instance: a7ca78a5-091b-4e44-9c63-e96881ffeddc] Received unexpected event network-vif-plugged-31296d0b-d5fa-4cb8-8292-7ddaf8855c99 for instance with vm_state deleted and task_state None.
Nov 18 16:05:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:05:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:06:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:06:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:06:04 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.177364349365234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dadd264c-85f2-4dfa-910b-da35c45450dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:06:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:06:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:06:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:06:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:06:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:06:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:06:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:06:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:06:29 user nova-compute[74839]: INFO nova.compute.claims [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Claim successful on node user
Nov 18 16:06:29 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:29 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:06:30 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.policy [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f71eb7e6ae7f4f399d08eeb9ebc98097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eebaec30e6d43a7aa4ba5aa548d3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:06:30 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Creating image(s)
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "/opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "/opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.part --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Successfully created port: 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.virt.images [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] 5d72c247-e8ea-481f-aea4-84e249aef672 was qcow2, converting to raw {{(pid=74839) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG nova.privsep.utils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74839) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 18 16:06:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.part /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.converted {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.part /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.converted" returned: 0 in 0.378s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.converted --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Successfully updated port: 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.compute.manager [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing instance network info cache due to event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.191s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json" returned: 0 in 0.206s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.network.neutron [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json" returned: 0 in 0.191s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322,backing_fmt=raw /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance network_info: |[{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.network.neutron [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322,backing_fmt=raw /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk 1073741824" returned: 0 in 0.049s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "08606e3eff0fe0c6fe963a36dc993ce2ef792322" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:06:31 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Cannot resize image /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Ensure instance console log exists: /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Start _get_guest_xml network_info=[{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:06:27Z,direct_url=<?>,disk_format='qcow2',id=5d72c247-e8ea-481f-aea4-84e249aef672,min_disk=0,min_ram=0,name='tempest-scenario-img--1739501603',owner='7eebaec30e6d43a7aa4ba5aa548d3954',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:06:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '5d72c247-e8ea-481f-aea4-84e249aef672'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:06:32 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:06:32 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T16:06:27Z,direct_url=<?>,disk_format='qcow2',id=5d72c247-e8ea-481f-aea4-84e249aef672,min_disk=0,min_ram=0,name='tempest-scenario-img--1739501603',owner='7eebaec30e6d43a7aa4ba5aa548d3954',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T16:06:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1314980537',display_name='tempest-TestMinimumBasicScenario-server-1314980537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1314980537',id=49,image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXx1/EY8zoxO+rKgsxa3TVjZ8OsA4q4ZkafKOtM0ujd4/1JlSN8Z2MPN1PqBmzyoINGSKX5R3VjUnLFSuXCY84rTIR8TZO9FQOPijbJYEybigW6GVzijiS4avrDTKD7Vg==',key_name='tempest-TestMinimumBasicScenario-925404096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-is0528cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:06:30Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=dd9a0804-e816-4d28-a5ca-062c0e5c60c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.objects.instance [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'pci_devices' on Instance uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated VIF entry in instance network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:06:32 user nova-compute[74839]:   <uuid>dd9a0804-e816-4d28-a5ca-062c0e5c60c0</uuid>
Nov 18 16:06:32 user nova-compute[74839]:   <name>instance-00000031</name>
Nov 18 16:06:32 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:06:32 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:06:32 user nova-compute[74839]:   <metadata>
Nov 18 16:06:32 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:06:32 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:name>tempest-TestMinimumBasicScenario-server-1314980537</nova:name>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:06:32</nova:creationTime>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:06:32 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:06:32 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:owner>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:user uuid="f71eb7e6ae7f4f399d08eeb9ebc98097">tempest-TestMinimumBasicScenario-147307032-project-member</nova:user>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:project uuid="7eebaec30e6d43a7aa4ba5aa548d3954">tempest-TestMinimumBasicScenario-147307032</nova:project>
Nov 18 16:06:32 user nova-compute[74839]:       </nova:owner>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:root type="image" uuid="5d72c247-e8ea-481f-aea4-84e249aef672"/>
Nov 18 16:06:32 user nova-compute[74839]:       <nova:ports>
Nov 18 16:06:32 user nova-compute[74839]:         <nova:port uuid="7a3777c4-d3ff-4339-b771-0b2f565332d5">
Nov 18 16:06:32 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 18 16:06:32 user nova-compute[74839]:         </nova:port>
Nov 18 16:06:32 user nova-compute[74839]:       </nova:ports>
Nov 18 16:06:32 user nova-compute[74839]:     </nova:instance>
Nov 18 16:06:32 user nova-compute[74839]:   </metadata>
Nov 18 16:06:32 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:06:32 user nova-compute[74839]:     <system>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="serial">dd9a0804-e816-4d28-a5ca-062c0e5c60c0</entry>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="uuid">dd9a0804-e816-4d28-a5ca-062c0e5c60c0</entry>
Nov 18 16:06:32 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:06:32 user nova-compute[74839]:     </system>
Nov 18 16:06:32 user nova-compute[74839]:   </sysinfo>
Nov 18 16:06:32 user nova-compute[74839]:   <os>
Nov 18 16:06:32 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:06:32 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:06:32 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:06:32 user nova-compute[74839]:   </os>
Nov 18 16:06:32 user nova-compute[74839]:   <features>
Nov 18 16:06:32 user nova-compute[74839]:     <acpi/>
Nov 18 16:06:32 user nova-compute[74839]:     <apic/>
Nov 18 16:06:32 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:06:32 user nova-compute[74839]:   </features>
Nov 18 16:06:32 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:06:32 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:06:32 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:06:32 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:06:32 user nova-compute[74839]:   </clock>
Nov 18 16:06:32 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:06:32 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:06:32 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:06:32 user nova-compute[74839]:   </cpu>
Nov 18 16:06:32 user nova-compute[74839]:   <devices>
Nov 18 16:06:32 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:06:32 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:06:32 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk"/>
Nov 18 16:06:32 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:06:32 user nova-compute[74839]:     </disk>
Nov 18 16:06:32 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:06:32 user nova-compute[74839]:       <mac address="fa:16:3e:e3:7f:ae"/>
Nov 18 16:06:32 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:06:32 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:06:32 user nova-compute[74839]:       <target dev="tap7a3777c4-d3"/>
Nov 18 16:06:32 user nova-compute[74839]:     </interface>
Nov 18 16:06:32 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:06:32 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/console.log" append="off"/>
Nov 18 16:06:32 user nova-compute[74839]:     </serial>
Nov 18 16:06:32 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:06:32 user nova-compute[74839]:     <video>
Nov 18 16:06:32 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:06:32 user nova-compute[74839]:     </video>
Nov 18 16:06:32 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:06:32 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:06:32 user nova-compute[74839]:     </rng>
Nov 18 16:06:32 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:06:32 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:06:32 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:06:32 user nova-compute[74839]:     </memballoon>
Nov 18 16:06:32 user nova-compute[74839]:   </devices>
Nov 18 16:06:32 user nova-compute[74839]: </domain>
Nov 18 16:06:32 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1314980537',display_name='tempest-TestMinimumBasicScenario-server-1314980537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1314980537',id=49,image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXx1/EY8zoxO+rKgsxa3TVjZ8OsA4q4ZkafKOtM0ujd4/1JlSN8Z2MPN1PqBmzyoINGSKX5R3VjUnLFSuXCY84rTIR8TZO9FQOPijbJYEybigW6GVzijiS4avrDTKD7Vg==',key_name='tempest-TestMinimumBasicScenario-925404096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-is0528cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:06:30Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=dd9a0804-e816-4d28-a5ca-062c0e5c60c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG os_vif [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c5ca5de-f30a-4b76-9755-fffa640960e8 req-946c7219-fdbd-4817-84d4-2f87d741e4ea service nova] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74968605-1e82-5d6d-92b2-46a841ee9055', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3777c4-d3, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3777c4-d3, col_values=(('qos', UUID('03a8df5b-29e2-4939-bee0-59202247dcbe')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3777c4-d3, col_values=(('external_ids', {'iface-id': '7a3777c4-d3ff-4339-b771-0b2f565332d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:7f:ae', 'vm-uuid': 'dd9a0804-e816-4d28-a5ca-062c0e5c60c0'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:32 user nova-compute[74839]: INFO os_vif [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3')
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:06:32 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No VIF found with MAC fa:16:3e:e3:7f:ae, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:33 user nova-compute[74839]: DEBUG nova.compute.manager [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:06:33 user nova-compute[74839]: WARNING nova.compute.manager [req-c81ec801-6bed-4cf2-90ad-33623a9e8f6b req-d445d633-0f97-48f0-803a-07a15e9c52c3 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state building and task_state spawning.
Nov 18 16:06:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:06:35 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance spawned successfully.
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.compute.manager [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:06:35 user nova-compute[74839]: WARNING nova.compute.manager [req-98fd0125-49a6-4b86-9859-e8ef70babe0d req-3ccda31a-ebb4-427d-a785-71186615bcba service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state building and task_state spawning.
Nov 18 16:06:35 user nova-compute[74839]: INFO nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 18 16:06:35 user nova-compute[74839]: DEBUG nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:06:35 user nova-compute[74839]: INFO nova.compute.manager [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Took 6.26 seconds to build instance.
Nov 18 16:06:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-73597559-909e-44d2-8e27-d8fe83e9e789 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.351s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:37 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:06:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-changed-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Refreshing instance network info cache due to event network-changed-5982d76d-b425-4dc7-acd7-d2621f24f57e. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Refreshing network info cache for port 5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated VIF entry in instance network info cache for port 5982d76d-b425-4dc7-acd7-d2621f24f57e. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG nova.network.neutron [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:06:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-364d545e-e958-4f5e-a4a1-5af5ed2999a0 req-88964672-b1a1-4556-829b-1fcc17bffcb4 service nova] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:06:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:06:59 user nova-compute[74839]: INFO nova.compute.manager [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Attaching volume d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 to /dev/vdb
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.utils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83e044-9539-45e1-9e6c-c05a07e43617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5619a-4906-4931-82b0-be5295add004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd846b6f-f858-48a1-ac6b-76e4ed58ce64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf932a56-97fc-4604-b3cc-6da6c31c1a9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:06:59 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:06:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e979681b-8abd-4d96-ad49-ad4d8a605765]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG os_brick.utils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:06:59 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating existing volume attachment record: b2e8bad6-6d66-49da-a671-ef7bb8c0f38f {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:07:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:03 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:07:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:07:04 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:07:04 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:07:04 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24893aa-bbe0-4ab5-990b-a9d5e02c3ea2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:07:04 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a7a7e-349b-432f-becc-8c2e511e3c21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9] added
Nov 18 16:07:04 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7f3854-7c58-46d2-bd7b-4d60ac09b253]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cf93c3-64c6-4074-afce-252fc1be6119]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZetzbGxl {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZetzbGxl" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b269416-fa55-4352-aa38-5fe769419c49]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZetzbGxl'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46095c-9443-4691-8aaa-232cdd3b4d08]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef40fed-b747-4952-a433-199bdcb6c66f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b8274-71cf-465a-b0f7-aea6ab6da80d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]
Nov 18 16:07:05 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.
Nov 18 16:07:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a169f0cc-edce-43da-ac02-25a9e801c26e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670d76c-378c-4aa7-b027-eb81a2cdc14c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:07:05 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c77cf58-bccc-4701-bcff-fa3098863d9d]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:05 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:06 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:07:06 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=25.118972778320312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dadd264c-85f2-4dfa-910b-da35c45450dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23764346139373863', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764346139373863', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.objects.instance [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:07:06 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:07:06 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:07:06 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:07:06 user nova-compute[74839]:   <serial>d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9</serial>
Nov 18 16:07:06 user nova-compute[74839]: </disk>
Nov 18 16:07:06 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No VIF found with MAC fa:16:3e:fd:02:fb, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-b18c5ce7-b1a9-40bf-afa4-974da7931809 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.291s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74839) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.objects.instance [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:07:07 user nova-compute[74839]: WARNING nova.compute.manager [req-7b50f57e-be6f-4b8b-b858-396b4161a954 req-62ba7634-e8d4-43bd-9b7b-d6d0c2b70a76 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state active and task_state powering-off.
Nov 18 16:07:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance destroyed successfully.
Nov 18 16:07:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:07:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-85e3b93f-e4e7-46cc-a800-8b8874de81c1 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.890s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:07:09 user nova-compute[74839]: WARNING nova.compute.manager [req-02ec1ce6-dc95-4dd8-83a6-7686903c35cd req-72977457-6501-41e4-8bd7-5c3b709c4a43 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state stopped and task_state None.
Nov 18 16:07:10 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:11 user nova-compute[74839]: INFO nova.compute.manager [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Terminating instance
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-unplugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] No waiting events found dispatching network-vif-unplugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-f360731b-9b4c-4b64-86b2-7b3c0e0dc386 req-1f6585e1-c01c-426f-85e8-816d940984f2 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-unplugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-changed-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Refreshing instance network info cache due to event network-changed-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] Acquiring lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] Acquired lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Refreshing network info cache for port 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updated VIF entry in instance network info cache for port 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.network.neutron [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating instance_info_cache with network_info: [{"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-6711aa3a-9000-4a47-8032-083abf68fab0 req-cf3e553c-2f2e-4bf2-a2ba-11761b75fadf service nova] Releasing lock "refresh_cache-dadd264c-85f2-4dfa-910b-da35c45450dd" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:07:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Instance destroyed successfully.
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid dadd264c-85f2-4dfa-910b-da35c45450dd {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1217726568',display_name='tempest-TestVolumeBootPattern-server-1217726568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1217726568',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-jjewmpg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:05:30Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=dadd264c-85f2-4dfa-910b-da35c45450dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "address": "fa:16:3e:62:a5:88", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ff7b3c0-5f", "ovs_interfaceid": "3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG os_vif [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ff7b3c0-5f, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c5d6d8e-a5c4-47e5-8509-e0b58cb93b49) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:07:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:11 user nova-compute[74839]: INFO os_vif [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:88,bridge_name='br-int',has_traffic_filtering=True,id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ff7b3c0-5f')
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:07:12 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a348b037-e631-4e2a-874b-b150fb5b8033]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:07:12 user nova-compute[74839]: No targets found.
Nov 18 16:07:12 user nova-compute[74839]: iSNS:
Nov 18 16:07:12 user nova-compute[74839]: No targets found.
Nov 18 16:07:12 user nova-compute[74839]: STATIC:
Nov 18 16:07:12 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9
Nov 18 16:07:12 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:07:12 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:07:12 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:07:12 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:07:12 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:07:12 user nova-compute[74839]: FIRMWARE:
Nov 18 16:07:12 user nova-compute[74839]: No targets found.
Nov 18 16:07:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:07:12 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:07:12 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49850ff-abb7-44ae-9794-46144b4e4776]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c6446-1445-4046-8e1a-4268299fce94]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:12 user nova-compute[74839]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:07:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:07:12 user nova-compute[74839]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:07:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49817a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c88c6b-fa16-4187-a085-f8b3a12acdcc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[31047519-eb01-44d7-a7f7-c24350ce96c3]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5a536-6c46-47d8-bd05-2d453b78c586]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a851a-f83c-462b-a821-1fc8f2212f75]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcee840-d106-4690-b74f-e32e964ce70a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5fcec1-4aeb-4955-aeeb-ad19f7cb46b6]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]
Nov 18 16:07:12 user nova-compute[74839]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.
Nov 18 16:07:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c6179-0629-4b97-89c4-bcd734dd87f2]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (324ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:07:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Deleting instance files /opt/stack/data/nova/instances/dadd264c-85f2-4dfa-910b-da35c45450dd_del
Nov 18 16:07:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Deletion of /opt/stack/data/nova/instances/dadd264c-85f2-4dfa-910b-da35c45450dd_del complete
Nov 18 16:07:12 user nova-compute[74839]: INFO nova.compute.manager [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 18 16:07:12 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:07:12 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Took 0.60 seconds to deallocate network for instance.
Nov 18 16:07:12 user nova-compute[74839]: DEBUG nova.compute.manager [req-01d97812-3b3a-4aed-b181-5fe14dee8a15 req-a7def570-d8cb-409a-a0d0-96655c1cd91d service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-deleted-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:12 user nova-compute[74839]: INFO nova.compute.manager [req-01d97812-3b3a-4aed-b181-5fe14dee8a15 req-a7def570-d8cb-409a-a0d0-96655c1cd91d service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Neutron deleted interface 3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb; detaching it from the instance and deleting it from the info cache
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.network.neutron [req-01d97812-3b3a-4aed-b181-5fe14dee8a15 req-a7def570-d8cb-409a-a0d0-96655c1cd91d service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-01d97812-3b3a-4aed-b181-5fe14dee8a15 req-a7def570-d8cb-409a-a0d0-96655c1cd91d service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Detach interface failed, port_id=3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb, reason: Instance dadd264c-85f2-4dfa-910b-da35c45450dd could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] Acquiring lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] No waiting events found dispatching network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:07:13 user nova-compute[74839]: WARNING nova.compute.manager [req-314eee9b-5afc-4f57-bd5d-67cc32b004fa req-7c773476-89c8-4dea-8f34-1eaebfc1ce01 service nova] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Received unexpected event network-vif-plugged-3ff7b3c0-5f1e-45f7-8fd4-d93dd7c12fcb for instance with vm_state active and task_state deleting.
Nov 18 16:07:13 user nova-compute[74839]: INFO nova.compute.manager [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: dadd264c-85f2-4dfa-910b-da35c45450dd] Took 0.71 seconds to detach 1 volumes for instance.
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:07:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:13 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance dadd264c-85f2-4dfa-910b-da35c45450dd
Nov 18 16:07:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dce976cf-2786-4561-a4d2-599cda7d030b tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "dadd264c-85f2-4dfa-910b-da35c45450dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:07:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Verify base images {{(pid=74839) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Image id 5d72c247-e8ea-481f-aea4-84e249aef672 yields fingerprint 08606e3eff0fe0c6fe963a36dc993ce2ef792322 {{(pid=74839) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] image 5d72c247-e8ea-481f-aea4-84e249aef672 at (/opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322): checking
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] image 5d72c247-e8ea-481f-aea4-84e249aef672 at (/opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322): image is in use {{(pid=74839) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74839) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Image id e059a7e6-6151-4faa-8cc1-55745cc1f78a yields fingerprint c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 {{(pid=74839) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] image e059a7e6-6151-4faa-8cc1-55745cc1f78a at (/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9): checking
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] image e059a7e6-6151-4faa-8cc1-55745cc1f78a at (/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9): image is in use {{(pid=74839) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] 081bc305-1c06-49b8-8520-a1d89be6af90 is a valid instance name {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] 081bc305-1c06-49b8-8520-a1d89be6af90 has a disk file {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 is backed by c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] dd9a0804-e816-4d28-a5ca-062c0e5c60c0 is a valid instance name {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] dd9a0804-e816-4d28-a5ca-062c0e5c60c0 has a disk file {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 is backed by 08606e3eff0fe0c6fe963a36dc993ce2ef792322 {{(pid=74839) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871
Nov 18 16:07:28 user nova-compute[74839]: WARNING nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Unknown base file: /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Active base files: /opt/stack/data/nova/instances/_base/08606e3eff0fe0c6fe963a36dc993ce2ef792322 /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Removable base files: /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343 /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50 /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5 /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871 /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21a510a82f6c25342367d2b6e07ba3f3b0e67ade
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/880cc69576fdc711d7bbcc41839225cbd1ff827d
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d0dfd378c351d623b8797887842355fab84d343
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/476dc4b6699cd78568d55ce4bd91e5aa4bac6b50
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/77c1ed071ef78b9a306b70dea0edaccdcf7b5a5c
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8579e07af6d7c8651c638f62f029073b1cec0de5
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/85afcaf9d3a3f62a195e14e8694fa5aaa8164871
Nov 18 16:07:28 user nova-compute[74839]: INFO nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/23029d0c5bf105b84f89602eaeed60f53dd8afcc
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Verification complete {{(pid=74839) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Verify swap images {{(pid=74839) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 18 16:07:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.imagecache [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Verify ephemeral images {{(pid=74839) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 18 16:07:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:07:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:07:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:07:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:07:42 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:47 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:07:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:08:02 user nova-compute[74839]: INFO nova.compute.claims [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Claim successful on node user
Nov 18 16:08:02 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:08:03 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:08:03 user nova-compute[74839]: INFO nova.virt.block_device [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Booting with volume 6e33e344-4ffc-4252-9667-01573d718c59 at /dev/vda
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.policy [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f06a7f-5911-4276-bd15-3760f16264a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d24ac1-0dde-4060-8201-c1874e0eefec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28cf91-6fb6-41ba-9b27-474ab2df502a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7b778-d716-45e7-a011-dfe90dc2af9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:08:03 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:08:03 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e337727-e9fe-4ff2-9058-912bff92e250]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG os_brick.utils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating existing volume attachment record: 05d3d8fe-ee6c-48bd-a6db-f55597a36cb3 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:03 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Successfully created port: 593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Successfully updated port: 593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-changed-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.compute.manager [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing instance network info cache due to event network-changed-593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] Acquiring lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Instance network_info: |[{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] Acquired lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG nova.network.neutron [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:08:04 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:05 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:05 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.117435455322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f68cdc54-c399-4c74-952a-f5abdfbc6816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.network.neutron [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updated VIF entry in instance network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.network.neutron [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e4aba95c-9cb9-46d8-a72d-c484df2b0a65 req-ec6b6111-18f6-4552-85b1-f2f709b11899 service nova] Releasing lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:08:05 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:08:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:08:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:06 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:08:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Creating image(s)
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Ensure instance console log exists: /opt/stack/data/nova/instances/f68cdc54-c399-4c74-952a-f5abdfbc6816/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Start _get_guest_xml network_info=[{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '05d3d8fe-ee6c-48bd-a6db-f55597a36cb3', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f68cdc54-c399-4c74-952a-f5abdfbc6816', 'attached_at': '', 'detached_at': '', 'volume_id': '6e33e344-4ffc-4252-9667-01573d718c59', 'serial': '6e33e344-4ffc-4252-9667-01573d718c59'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:08:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:08 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e24dcc-a419-49ad-9722-db9559461c53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:08:08 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b2dd15-8118-4baa-94b1-0603b9fc28a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59] added
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b05a1d1-9d2e-4e6b-91b1-5652b34d73b9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcbf745-755b-47d0-b8ea-6ed120aeb5d9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBsrpcdg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MBsrpcdg" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a073f-f22a-4398-a993-3206aa055976]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MBsrpcdg'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1980f-3a6a-4701-a726-f38a995daece]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e493e-07d0-468a-882d-85ad113c3ff8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c5c07b-8cd7-4bca-a6f7-88c6a401ca3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]
Nov 18 16:08:08 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ed9e5-2c1e-4292-a61a-cd0b18524a16]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72d01c5-39ec-4a50-a794-e047fc9d825f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b8234-56b3-4a64-9b86-e5834cce7a72]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23332326638363866', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332326638363866', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-259005468',display_name='tempest-TestVolumeBootPattern-server-259005468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-259005468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-or40w05f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:08:03Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=f68cdc54-c399-4c74-952a-f5abdfbc6816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid f68cdc54-c399-4c74-952a-f5abdfbc6816 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:08:09 user nova-compute[74839]:   <uuid>f68cdc54-c399-4c74-952a-f5abdfbc6816</uuid>
Nov 18 16:08:09 user nova-compute[74839]:   <name>instance-00000032</name>
Nov 18 16:08:09 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:08:09 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:08:09 user nova-compute[74839]:   <metadata>
Nov 18 16:08:09 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:08:09 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:08:09 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-server-259005468</nova:name>
Nov 18 16:08:09 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:08:08</nova:creationTime>
Nov 18 16:08:09 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:08:09 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:08:09 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:08:09 user nova-compute[74839]:       <nova:owner>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 16:08:09 user nova-compute[74839]:       </nova:owner>
Nov 18 16:08:09 user nova-compute[74839]:       <nova:ports>
Nov 18 16:08:09 user nova-compute[74839]:         <nova:port uuid="593160b6-509a-484f-bbfd-490df84da0ec">
Nov 18 16:08:09 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 18 16:08:09 user nova-compute[74839]:         </nova:port>
Nov 18 16:08:09 user nova-compute[74839]:       </nova:ports>
Nov 18 16:08:09 user nova-compute[74839]:     </nova:instance>
Nov 18 16:08:09 user nova-compute[74839]:   </metadata>
Nov 18 16:08:09 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:08:09 user nova-compute[74839]:     <system>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="serial">f68cdc54-c399-4c74-952a-f5abdfbc6816</entry>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="uuid">f68cdc54-c399-4c74-952a-f5abdfbc6816</entry>
Nov 18 16:08:09 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:08:09 user nova-compute[74839]:     </system>
Nov 18 16:08:09 user nova-compute[74839]:   </sysinfo>
Nov 18 16:08:09 user nova-compute[74839]:   <os>
Nov 18 16:08:09 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:08:09 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:08:09 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:08:09 user nova-compute[74839]:   </os>
Nov 18 16:08:09 user nova-compute[74839]:   <features>
Nov 18 16:08:09 user nova-compute[74839]:     <acpi/>
Nov 18 16:08:09 user nova-compute[74839]:     <apic/>
Nov 18 16:08:09 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:08:09 user nova-compute[74839]:   </features>
Nov 18 16:08:09 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:08:09 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:08:09 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:08:09 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:08:09 user nova-compute[74839]:   </clock>
Nov 18 16:08:09 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:08:09 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:08:09 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:08:09 user nova-compute[74839]:   </cpu>
Nov 18 16:08:09 user nova-compute[74839]:   <devices>
Nov 18 16:08:09 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:08:09 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:08:09 user nova-compute[74839]:       <source dev="/dev/sdb"/>
Nov 18 16:08:09 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:08:09 user nova-compute[74839]:       <serial>6e33e344-4ffc-4252-9667-01573d718c59</serial>
Nov 18 16:08:09 user nova-compute[74839]:     </disk>
Nov 18 16:08:09 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:08:09 user nova-compute[74839]:       <mac address="fa:16:3e:22:d8:00"/>
Nov 18 16:08:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:08:09 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:08:09 user nova-compute[74839]:       <target dev="tap593160b6-50"/>
Nov 18 16:08:09 user nova-compute[74839]:     </interface>
Nov 18 16:08:09 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:08:09 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/f68cdc54-c399-4c74-952a-f5abdfbc6816/console.log" append="off"/>
Nov 18 16:08:09 user nova-compute[74839]:     </serial>
Nov 18 16:08:09 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:08:09 user nova-compute[74839]:     <video>
Nov 18 16:08:09 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:08:09 user nova-compute[74839]:     </video>
Nov 18 16:08:09 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:08:09 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:08:09 user nova-compute[74839]:     </rng>
Nov 18 16:08:09 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:08:09 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:08:09 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:08:09 user nova-compute[74839]:     </memballoon>
Nov 18 16:08:09 user nova-compute[74839]:   </devices>
Nov 18 16:08:09 user nova-compute[74839]: </domain>
Nov 18 16:08:09 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-259005468',display_name='tempest-TestVolumeBootPattern-server-259005468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-259005468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-or40w05f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:08:03Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=f68cdc54-c399-4c74-952a-f5abdfbc6816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG os_vif [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e38ba530-e855-576e-b423-46cb6d6bf5ab', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap593160b6-50, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap593160b6-50, col_values=(('qos', UUID('645524d4-d805-4d1e-b0b6-59c58339d3da')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap593160b6-50, col_values=(('external_ids', {'iface-id': '593160b6-509a-484f-bbfd-490df84da0ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d8:00', 'vm-uuid': 'f68cdc54-c399-4c74-952a-f5abdfbc6816'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:10 user nova-compute[74839]: INFO os_vif [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50')
Nov 18 16:08:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:22:d8:00, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:10 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] No waiting events found dispatching network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:11 user nova-compute[74839]: WARNING nova.compute.manager [req-03d5d9f4-2d3a-4350-9567-9af199965128 req-299adcae-591c-47ea-bc43-4edd167d5570 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received unexpected event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec for instance with vm_state building and task_state spawning.
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:08:13 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Instance spawned successfully.
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:08:13 user nova-compute[74839]: INFO nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:08:13 user nova-compute[74839]: INFO nova.compute.manager [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Took 10.81 seconds to build instance.
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] No waiting events found dispatching network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:13 user nova-compute[74839]: WARNING nova.compute.manager [req-f54f4c48-0c8e-4149-bbba-f98afb34fd44 req-bbe84040-b56c-42db-bafd-bd9095bd70e7 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received unexpected event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec for instance with vm_state active and task_state None.
Nov 18 16:08:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71454af5-6a1d-407b-b9fe-1a1179c00b97 tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.904s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:15 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:22 user nova-compute[74839]: DEBUG nova.objects.instance [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:23 user nova-compute[74839]: INFO nova.compute.manager [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Attaching volume 7d0006e8-48cd-4ee7-8a76-24001e455643 to /dev/vdb
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.utils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ae2a9-b7ce-4d4f-9be1-e5bc32f84e61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d46938-a2f1-418c-92b8-4e96a186bf23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[891cf494-efdd-40d8-be95-6dfcf290adaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b0b4e-51a5-4d26-ba24-15791be0afd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:08:23 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:08:23 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfea58a-ee29-4385-af14-b469f18c25d5]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG os_brick.utils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:08:23 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating existing volume attachment record: 61c6c614-1876-4f08-83a1-273be4a5baaa {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:08:25 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFONakcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:28 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:28 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:28 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadbefb2-dea6-4c35-84fa-99c836a216cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:08:28 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64494b4-dc57-47eb-a2e5-123d7730e72a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643] added
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f7da8c-e15e-49bb-9bb5-2c9b2a4f2a8f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1a0756-1df1-4bbe-9c62-3d2527e2d856]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFONakcv {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFONakcv" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2481935-eacc-4a37-9d02-2b620f3accad]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFONakcv'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3686e9-4478-4c23-a1cc-fa30f665bf59]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85289ce-d8c7-44b6-8a02-f8956be8d521]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[76876c57-206a-4a5a-b404-7260d4799981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260]
Nov 18 16:08:28 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260] successful.
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6bcf65-866e-4613-98a2-2f310c47e5a8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ac68f-75fc-4a9c-a2cd-9ab3012a7ede]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:28 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b418e8-1b0d-4945-bd4f-de3147503d77]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:28 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFONakcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23432376630626161', 'path': '/dev/sdd'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432376630626161', 'path': '/dev/sdd'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG nova.objects.instance [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:29 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:08:29 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:08:29 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:08:29 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:08:29 user nova-compute[74839]:   <serial>7d0006e8-48cd-4ee7-8a76-24001e455643</serial>
Nov 18 16:08:29 user nova-compute[74839]: </disk>
Nov 18 16:08:29 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] No VIF found with MAC fa:16:3e:e3:7f:ae, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-454278d2-6fe6-433b-9b64-c5ab9d295a26 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.296s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:30 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:32 user nova-compute[74839]: DEBUG nova.compute.manager [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing instance network info cache due to event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:08:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:32 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:32 user nova-compute[74839]: DEBUG nova.network.neutron [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:08:33 user nova-compute[74839]: DEBUG nova.network.neutron [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated VIF entry in instance network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:08:33 user nova-compute[74839]: DEBUG nova.network.neutron [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:33 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-027d45e5-66a1-4375-99e0-67617672dac8 req-0814596b-b67b-4b32-9b5c-d3973d9ccd0e service nova] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:34 user nova-compute[74839]: DEBUG nova.compute.manager [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing instance network info cache due to event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:08:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:34 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:34 user nova-compute[74839]: DEBUG nova.network.neutron [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG nova.network.neutron [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated VIF entry in instance network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG nova.network.neutron [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bf0aaceb-428e-48a1-a0f1-356459e561a0 req-1f422f28-c549-4706-b110-e83c24c0733f service nova] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:35 user nova-compute[74839]: INFO nova.compute.manager [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Rebooting instance
Nov 18 16:08:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:35 user nova-compute[74839]: DEBUG nova.network.neutron [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:08:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:08:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:38 user nova-compute[74839]: WARNING nova.compute.manager [req-e7636feb-542f-47a5-913c-573ef5f643b1 req-442f68f8-5ffa-4c30-936f-ca416a3230f0 service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance shutdown successfully.
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:40 user nova-compute[74839]: WARNING nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:40 user nova-compute[74839]: WARNING nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:40 user nova-compute[74839]: WARNING nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:40 user nova-compute[74839]: WARNING nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:40 user nova-compute[74839]: DEBUG nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:40 user nova-compute[74839]: WARNING nova.compute.manager [req-c04db9fb-e5c2-4e91-a326-cfe94df434b5 req-c01a01ca-6595-4e31-89e3-24669aa4861f service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state reboot_started.
Nov 18 16:08:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance running successfully.
Nov 18 16:08:42 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance soft rebooted successfully.
Nov 18 16:08:42 user nova-compute[74839]: DEBUG nova.compute.manager [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-286a8018-4da2-4d0a-b7b2-6c14139d825e tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.101s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:42 user nova-compute[74839]: WARNING nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state None.
Nov 18 16:08:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:42 user nova-compute[74839]: DEBUG nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:08:42 user nova-compute[74839]: WARNING nova.compute.manager [req-7f588134-e70e-46a1-be11-c30ef79da635 req-eb5ebef5-7dba-4969-862d-e742218f301c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state active and task_state None.
Nov 18 16:08:45 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Triggering sync for uuid f68cdc54-c399-4c74-952a-f5abdfbc6816 {{(pid=74839) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:08:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:57 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.network.neutron [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:08:58 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance destroyed successfully.
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'resources' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5982d76d-b4, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e118d76-936e-4fb1-8a20-04906dd0df9c) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:08:58 user nova-compute[74839]: INFO os_vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:08:58 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:58 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa0bd1-a81e-4aa3-bdd1-7899d09e432b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:08:58 user nova-compute[74839]: No targets found.
Nov 18 16:08:58 user nova-compute[74839]: iSNS:
Nov 18 16:08:58 user nova-compute[74839]: No targets found.
Nov 18 16:08:58 user nova-compute[74839]: STATIC:
Nov 18 16:08:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9
Nov 18 16:08:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:08:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:08:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:08:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:08:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:08:58 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643
Nov 18 16:08:58 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:08:58 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:08:58 user nova-compute[74839]: FIRMWARE:
Nov 18 16:08:58 user nova-compute[74839]: No targets found.
Nov 18 16:08:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:08:58 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:08:58 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a40ab3-d266-4124-bd9e-18743e5d3189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b8f060-d37c-4db3-90f0-7edbab2601ac]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:58 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801cc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[001fe10a-045d-4cf6-9253-db7301844a4f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416e660-f612-4c7d-b1b1-e54799397557]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f160abfb-1ec0-4944-a3cc-f30461169afa]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:08:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3383c9-ae9f-4159-bc8b-0d987229304c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25712a-b678-440f-a767-c39b0a5b486e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d1884-ff85-43fd-be4f-b9695e25f399]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]
Nov 18 16:08:59 user nova-compute[74839]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd9487-9508-481f-9839-4897be6a6e0e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== disconnect_volume: return (295ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start _get_guest_xml network_info=[{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'b2e8bad6-6d66-49da-a671-ef7bb8c0f38f', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '081bc305-1c06-49b8-8520-a1d89be6af90', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'serial': 'd5de3bf6-3c80-405c-b8b8-302e0b1f7cb9'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'numa_topology' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:08:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:59 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:08:59 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:59 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:08:59 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e43916-8f93-4432-8492-5f0fea7b9d7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:08:59 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a172e-249f-4111-84e9-89c10ea030e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9] added
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c0089c-d6c6-467c-962b-f19b99fda56e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d064272-d5af-4205-9223-7819bafa08ae]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZetzbGxl {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZetzbGxl" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459ab6e-8dd0-427a-8e8c-6c4b4c269259]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZetzbGxl'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8d1d2-e3f1-4a8c-aec0-7133c0815b11]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c12f7-2e40-4da7-a722-40fef7de7665]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56864c2-2c63-4821-8990-825fd99a75cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]
Nov 18 16:08:59 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[128cbe52-d4be-4011-a839-b2607c9c5c94]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06c923-72fb-4aed-bbc6-9f7676360212]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:08:59 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed022a19-2764-49ef-8157-709d936485e4]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:08:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23764346139373863', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764346139373863', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'pci_devices' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:09:00 user nova-compute[74839]:   <uuid>081bc305-1c06-49b8-8520-a1d89be6af90</uuid>
Nov 18 16:09:00 user nova-compute[74839]:   <name>instance-0000002f</name>
Nov 18 16:09:00 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:09:00 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:09:00 user nova-compute[74839]:   <metadata>
Nov 18 16:09:00 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:09:00 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeTestJSON-server-1557433728</nova:name>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:08:59</nova:creationTime>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:09:00 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:09:00 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:owner>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:user uuid="d2c0abdcb59a49a5b5aae8f0ef925f27">tempest-AttachVolumeTestJSON-689484882-project-member</nova:user>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:project uuid="39ae89917b5d41f5bc1216f055dc263d">tempest-AttachVolumeTestJSON-689484882</nova:project>
Nov 18 16:09:00 user nova-compute[74839]:       </nova:owner>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:09:00 user nova-compute[74839]:       <nova:ports>
Nov 18 16:09:00 user nova-compute[74839]:         <nova:port uuid="5982d76d-b425-4dc7-acd7-d2621f24f57e">
Nov 18 16:09:00 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 16:09:00 user nova-compute[74839]:         </nova:port>
Nov 18 16:09:00 user nova-compute[74839]:       </nova:ports>
Nov 18 16:09:00 user nova-compute[74839]:     </nova:instance>
Nov 18 16:09:00 user nova-compute[74839]:   </metadata>
Nov 18 16:09:00 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:09:00 user nova-compute[74839]:     <system>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="serial">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="uuid">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:09:00 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:09:00 user nova-compute[74839]:     </system>
Nov 18 16:09:00 user nova-compute[74839]:   </sysinfo>
Nov 18 16:09:00 user nova-compute[74839]:   <os>
Nov 18 16:09:00 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:09:00 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:09:00 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:09:00 user nova-compute[74839]:   </os>
Nov 18 16:09:00 user nova-compute[74839]:   <features>
Nov 18 16:09:00 user nova-compute[74839]:     <acpi/>
Nov 18 16:09:00 user nova-compute[74839]:     <apic/>
Nov 18 16:09:00 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:09:00 user nova-compute[74839]:   </features>
Nov 18 16:09:00 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:09:00 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:09:00 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:09:00 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:09:00 user nova-compute[74839]:   </clock>
Nov 18 16:09:00 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:09:00 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:09:00 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:09:00 user nova-compute[74839]:   </cpu>
Nov 18 16:09:00 user nova-compute[74839]:   <devices>
Nov 18 16:09:00 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:09:00 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:09:00 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk"/>
Nov 18 16:09:00 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:09:00 user nova-compute[74839]:     </disk>
Nov 18 16:09:00 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:09:00 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:09:00 user nova-compute[74839]:       <source dev="/dev/sdc"/>
Nov 18 16:09:00 user nova-compute[74839]:       <target dev="vdb" bus="virtio"/>
Nov 18 16:09:00 user nova-compute[74839]:       <serial>d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9</serial>
Nov 18 16:09:00 user nova-compute[74839]:     </disk>
Nov 18 16:09:00 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:09:00 user nova-compute[74839]:       <mac address="fa:16:3e:fd:02:fb"/>
Nov 18 16:09:00 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:09:00 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:09:00 user nova-compute[74839]:       <target dev="tap5982d76d-b4"/>
Nov 18 16:09:00 user nova-compute[74839]:     </interface>
Nov 18 16:09:00 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:09:00 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/console.log" append="off"/>
Nov 18 16:09:00 user nova-compute[74839]:     </serial>
Nov 18 16:09:00 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:09:00 user nova-compute[74839]:     <video>
Nov 18 16:09:00 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:09:00 user nova-compute[74839]:     </video>
Nov 18 16:09:00 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:09:00 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:09:00 user nova-compute[74839]:     </rng>
Nov 18 16:09:00 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:09:00 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:09:00 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:09:00 user nova-compute[74839]:     </memballoon>
Nov 18 16:09:00 user nova-compute[74839]:   </devices>
Nov 18 16:09:00 user nova-compute[74839]: </domain>
Nov 18 16:09:00 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:09:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Cannot resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'migration_context' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.objects.base [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG os_vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38ff6ea8-13c7-5e86-8aab-d43756053a54', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5982d76d-b4, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5982d76d-b4, col_values=(('qos', UUID('5300740d-9b75-4a01-b89c-dba2ac737fe9')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5982d76d-b4, col_values=(('external_ids', {'iface-id': '5982d76d-b425-4dc7-acd7-d2621f24f57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:02:fb', 'vm-uuid': '081bc305-1c06-49b8-8520-a1d89be6af90'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:01 user nova-compute[74839]: INFO os_vif [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:09:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:09:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:09:02 user nova-compute[74839]: WARNING nova.compute.manager [req-1589b4f1-64e7-49e6-be95-fecd77e373d7 req-9c688025-488c-4b15-b54c-87f5d1458745 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state stopped and task_state powering-on.
Nov 18 16:09:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:09:04 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance rebooted successfully.
Nov 18 16:09:04 user nova-compute[74839]: DEBUG nova.compute.manager [None req-f6aae7ee-59d7-4b9b-867a-f47b8b6030b8 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:09:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:09:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:09:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:09:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:09:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:09:05 user nova-compute[74839]: WARNING nova.compute.manager [req-2ed4a101-bb52-4f28-a350-b956f2e61726 req-2889a952-4aae-49d4-982d-ac4822fba806 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state active and task_state None.
Nov 18 16:09:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:09:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:09:07 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:09:07 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.113719940185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f68cdc54-c399-4c74-952a-f5abdfbc6816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:09:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:09:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:09:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:09:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-changed-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:09:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing instance network info cache due to event network-changed-593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:09:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] Acquiring lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:09:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] Acquired lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:09:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:09:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updated VIF entry in instance network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:09:55 user nova-compute[74839]: DEBUG nova.network.neutron [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:09:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-88d49522-f5f6-4aea-add2-0ae31585ef52 req-bd93e210-8f54-4d29-bfc6-b9f5331c39c1 service nova] Releasing lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:09:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:09:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:10:00 user nova-compute[74839]: INFO nova.compute.claims [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Claim successful on node user
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:10:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:10:00 user nova-compute[74839]: INFO nova.virt.block_device [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Booting with volume 048deca3-eb2a-4278-b365-460bb59f0f00 at /dev/vda
Nov 18 16:10:00 user nova-compute[74839]: DEBUG nova.policy [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6345d428e0246f1b6120c19b5b4c72c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1ac31c8bb643b6a6cab7d0c06d227d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG os_brick.utils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83b3d0-885a-45eb-a6b1-282ebc5af16d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b955157-1385-4692-a50c-38efcae146b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[184b1953-5328-4cea-8be2-360d69fbd133]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36faf5d-c6b3-446f-a4a2-739843b4b5d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:00 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:10:01 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:10:01 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f265178-0d64-47a6-85b9-2a952f1208a9]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG os_brick.utils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== get_connector_properties: return (239ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating existing volume attachment record: ebcd0a9b-74ee-4f7e-ae93-e7f7af577a84 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:01 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Successfully created port: c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Successfully updated port: c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquired lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-changed-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.compute.manager [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing instance network info cache due to event network-changed-c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] Acquiring lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Releasing lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Instance network_info: |[{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] Acquired lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:10:02 user nova-compute[74839]: DEBUG nova.network.neutron [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing network info cache for port c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:10:03 user nova-compute[74839]: DEBUG nova.network.neutron [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updated VIF entry in instance network info cache for port c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:10:03 user nova-compute[74839]: DEBUG nova.network.neutron [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:10:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-0704f9a4-b985-4fd1-b06f-1078ec30647a req-8f4625f0-8097-402a-9817-cea7ac8f0eab service nova] Releasing lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:10:04 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:10:06 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Creating image(s)
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Did not create local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Ensure instance console log exists: /opt/stack/data/nova/instances/ab853461-8060-4dca-b2db-8032b1a93db8/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Start _get_guest_xml network_info=[{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ebcd0a9b-74ee-4f7e-ae93-e7f7af577a84', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmqVMOjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab853461-8060-4dca-b2db-8032b1a93db8', 'attached_at': '', 'detached_at': '', 'volume_id': '048deca3-eb2a-4278-b365-460bb59f0f00', 'serial': '048deca3-eb2a-4278-b365-460bb59f0f00'}, 'volume_type': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:10:06 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:10:06 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmqVMOjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:10:06 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:10:06 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:10:06 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9094f-dbaa-49f3-b09f-4223b9770b6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:10:06 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae8053-fde5-4a34-8a58-0009f894abf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00] added
Nov 18 16:10:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5332f4-03d2-41bb-9121-fc24c14d8090]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4cdec-e8ac-48eb-9988-ea9f2a3b1e16]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmqVMOjn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmqVMOjn" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630543e-69bd-4986-a6fd-5e9dc27f0125]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmqVMOjn'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0682b6-9521-4bcf-b772-2701f616916c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6eaf3-3ba5-429c-9c7c-a88be19fbb3f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89824e2-5cee-4f09-bc15-b4f76dfb15b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260]
Nov 18 16:10:06 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260] successful.
Nov 18 16:10:06 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ce1478-1f5e-45c7-ac9f-874c600ccac8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:06 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[63415f03-e915-4b94-a0db-a157bf8d7d6c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:10:07 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] HCTL ('36', '-', '-', 0) found on session 61 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c72fd9-7fd8-435c-8b54-5b603d80cb67]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Searching for a device in session 61 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmqVMOjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23434356463323636', 'path': '/dev/sde'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434356463323636', 'path': '/dev/sde'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927748780',display_name='tempest-TestVolumeBootPattern-server-927748780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927748780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-a3jfkbd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:10:01Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab853461-8060-4dca-b2db-8032b1a93db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'pci_devices' on Instance uuid ab853461-8060-4dca-b2db-8032b1a93db8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:10:08 user nova-compute[74839]:   <uuid>ab853461-8060-4dca-b2db-8032b1a93db8</uuid>
Nov 18 16:10:08 user nova-compute[74839]:   <name>instance-00000033</name>
Nov 18 16:10:08 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:10:08 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:10:08 user nova-compute[74839]:   <metadata>
Nov 18 16:10:08 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:10:08 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:10:08 user nova-compute[74839]:       <nova:name>tempest-TestVolumeBootPattern-server-927748780</nova:name>
Nov 18 16:10:08 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:10:06</nova:creationTime>
Nov 18 16:10:08 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:10:08 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:10:08 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:10:08 user nova-compute[74839]:       <nova:owner>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:user uuid="e6345d428e0246f1b6120c19b5b4c72c">tempest-TestVolumeBootPattern-1298499824-project-member</nova:user>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:project uuid="5f1ac31c8bb643b6a6cab7d0c06d227d">tempest-TestVolumeBootPattern-1298499824</nova:project>
Nov 18 16:10:08 user nova-compute[74839]:       </nova:owner>
Nov 18 16:10:08 user nova-compute[74839]:       <nova:ports>
Nov 18 16:10:08 user nova-compute[74839]:         <nova:port uuid="c685abfd-0fef-431a-b75d-7603dba75377">
Nov 18 16:10:08 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 18 16:10:08 user nova-compute[74839]:         </nova:port>
Nov 18 16:10:08 user nova-compute[74839]:       </nova:ports>
Nov 18 16:10:08 user nova-compute[74839]:     </nova:instance>
Nov 18 16:10:08 user nova-compute[74839]:   </metadata>
Nov 18 16:10:08 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:10:08 user nova-compute[74839]:     <system>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="serial">ab853461-8060-4dca-b2db-8032b1a93db8</entry>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="uuid">ab853461-8060-4dca-b2db-8032b1a93db8</entry>
Nov 18 16:10:08 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:10:08 user nova-compute[74839]:     </system>
Nov 18 16:10:08 user nova-compute[74839]:   </sysinfo>
Nov 18 16:10:08 user nova-compute[74839]:   <os>
Nov 18 16:10:08 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:10:08 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:10:08 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:10:08 user nova-compute[74839]:   </os>
Nov 18 16:10:08 user nova-compute[74839]:   <features>
Nov 18 16:10:08 user nova-compute[74839]:     <acpi/>
Nov 18 16:10:08 user nova-compute[74839]:     <apic/>
Nov 18 16:10:08 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:10:08 user nova-compute[74839]:   </features>
Nov 18 16:10:08 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:10:08 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:10:08 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:10:08 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:10:08 user nova-compute[74839]:   </clock>
Nov 18 16:10:08 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:10:08 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:10:08 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:10:08 user nova-compute[74839]:   </cpu>
Nov 18 16:10:08 user nova-compute[74839]:   <devices>
Nov 18 16:10:08 user nova-compute[74839]:     <disk type="block" device="disk">
Nov 18 16:10:08 user nova-compute[74839]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:10:08 user nova-compute[74839]:       <source dev="/dev/sde"/>
Nov 18 16:10:08 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:10:08 user nova-compute[74839]:       <serial>048deca3-eb2a-4278-b365-460bb59f0f00</serial>
Nov 18 16:10:08 user nova-compute[74839]:     </disk>
Nov 18 16:10:08 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:10:08 user nova-compute[74839]:       <mac address="fa:16:3e:1c:43:65"/>
Nov 18 16:10:08 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:10:08 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:10:08 user nova-compute[74839]:       <target dev="tapc685abfd-0f"/>
Nov 18 16:10:08 user nova-compute[74839]:     </interface>
Nov 18 16:10:08 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:10:08 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/ab853461-8060-4dca-b2db-8032b1a93db8/console.log" append="off"/>
Nov 18 16:10:08 user nova-compute[74839]:     </serial>
Nov 18 16:10:08 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:10:08 user nova-compute[74839]:     <video>
Nov 18 16:10:08 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:10:08 user nova-compute[74839]:     </video>
Nov 18 16:10:08 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:10:08 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:10:08 user nova-compute[74839]:     </rng>
Nov 18 16:10:08 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:10:08 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:10:08 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:10:08 user nova-compute[74839]:     </memballoon>
Nov 18 16:10:08 user nova-compute[74839]:   </devices>
Nov 18 16:10:08 user nova-compute[74839]: </domain>
Nov 18 16:10:08 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927748780',display_name='tempest-TestVolumeBootPattern-server-927748780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927748780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-a3jfkbd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:10:01Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab853461-8060-4dca-b2db-8032b1a93db8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG os_vif [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8438453a-71f1-5819-91c4-887838ffb8af', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc685abfd-0f, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc685abfd-0f, col_values=(('qos', UUID('5cbee032-ad38-4d54-bf45-9e7235bae05d')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc685abfd-0f, col_values=(('external_ids', {'iface-id': 'c685abfd-0fef-431a-b75d-7603dba75377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:43:65', 'vm-uuid': 'ab853461-8060-4dca-b2db-8032b1a93db8'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:08 user nova-compute[74839]: INFO os_vif [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f')
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] No VIF found with MAC fa:16:3e:1c:43:65, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:08 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG nova.compute.manager [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] No waiting events found dispatching network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:10:09 user nova-compute[74839]: WARNING nova.compute.manager [req-b23a0ad9-92fb-42fd-b0a6-f15ede02ac43 req-5d0de6e8-69d5-4f5f-8b1a-6ff700c884af service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received unexpected event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 for instance with vm_state building and task_state spawning.
Nov 18 16:10:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:10:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:10:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:10:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:10:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.104312896728516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f68cdc54-c399-4c74-952a-f5abdfbc6816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab853461-8060-4dca-b2db-8032b1a93db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:10:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Instance spawned successfully.
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:10:11 user nova-compute[74839]: INFO nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] No waiting events found dispatching network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:10:11 user nova-compute[74839]: WARNING nova.compute.manager [req-dfcaab76-cbfa-4680-b6de-63f72b8cace3 req-7042055d-7e51-45f7-a01d-bee9dfebff2e service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received unexpected event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 for instance with vm_state building and task_state spawning.
Nov 18 16:10:11 user nova-compute[74839]: INFO nova.compute.manager [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Took 11.37 seconds to build instance.
Nov 18 16:10:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0850b5eb-d585-4256-8d60-1b49dc6b337e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.462s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:10:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:10:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing instance network info cache due to event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated VIF entry in instance network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:10:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2251e5af-ae09-4a52-88b9-b4a301d74bc6 req-e544340f-35c4-4628-b03a-3a03b836928b service nova] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.compute.manager [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing instance network info cache due to event network-changed-7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] Acquiring lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] Acquired lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Refreshing network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:28 user nova-compute[74839]: INFO nova.compute.manager [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Detaching volume 7d0006e8-48cd-4ee7-8a76-24001e455643
Nov 18 16:10:28 user nova-compute[74839]: INFO nova.virt.block_device [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Attempting to driver detach volume 7d0006e8-48cd-4ee7-8a76-24001e455643 from mountpoint /dev/vdb
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Attempting to detach device vdb from instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:10:28 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:10:28 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:10:28 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:10:28 user nova-compute[74839]:   <serial>7d0006e8-48cd-4ee7-8a76-24001e455643</serial>
Nov 18 16:10:28 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:10:28 user nova-compute[74839]: </disk>
Nov 18 16:10:28 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:10:28 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully detached device vdb from instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 from the persistent domain config.
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:10:28 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:10:28 user nova-compute[74839]:   <source dev="/dev/sdd"/>
Nov 18 16:10:28 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:10:28 user nova-compute[74839]:   <serial>7d0006e8-48cd-4ee7-8a76-24001e455643</serial>
Nov 18 16:10:28 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:10:28 user nova-compute[74839]: </disk>
Nov 18 16:10:28 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updated VIF entry in instance network info cache for port 7a3777c4-d3ff-4339-b771-0b2f565332d5. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [{"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-1eedec54-534c-499d-a86f-f5693a20fc40 req-c3c820df-cefd-4215-85d4-963132ee017e service nova] Releasing lock "refresh_cache-dd9a0804-e816-4d28-a5ca-062c0e5c60c0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:10:28 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:10:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:48 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 is timed out.
Nov 18 16:10:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully detached device vdb from instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 from the live domain config.
Nov 18 16:10:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFONakcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:10:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[55da251b-510f-4d51-8d33-be8f786b304b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:10:48 user nova-compute[74839]: No targets found.
Nov 18 16:10:48 user nova-compute[74839]: iSNS:
Nov 18 16:10:48 user nova-compute[74839]: No targets found.
Nov 18 16:10:48 user nova-compute[74839]: STATIC:
Nov 18 16:10:48 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9
Nov 18 16:10:48 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:10:48 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:10:48 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:10:48 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:10:48 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:10:48 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643
Nov 18 16:10:48 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:10:48 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:10:48 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00
Nov 18 16:10:48 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:10:48 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:10:48 user nova-compute[74839]: FIRMWARE:
Nov 18 16:10:48 user nova-compute[74839]: No targets found.
Nov 18 16:10:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:10:48 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:10:48 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fae3433-2181-4871-9fdc-f6b503f8733e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd262e-e4eb-4d70-821e-c28fa2805f8a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:10:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a4292050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643'): ({'sdd'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Removing single pathed devices sdd {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984391d-fbc6-467a-ac46-8b02b0b3235e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[969397e7-0f20-4883-9a59-3216d80b3bb2]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Flushing IO for device /dev/sdd {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ed8f4-d19b-46db-ae8a-7ca02d973117]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:10:48 user nova-compute[74839]: INFO nova.compute.manager [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Detaching volume d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c1fc62-12e4-4e76-b71b-ee880c2360a7]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] SCSI volumes sdd have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ba813-aa6d-4553-a04a-4325c824c99b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:49 user nova-compute[74839]: INFO nova.virt.block_device [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Attempting to driver detach volume d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 from mountpoint /dev/vdb
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Attempting to detach device vdb from instance 081bc305-1c06-49b8-8520-a1d89be6af90 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:10:49 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:10:49 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:10:49 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:10:49 user nova-compute[74839]:   <serial>d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9</serial>
Nov 18 16:10:49 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 16:10:49 user nova-compute[74839]: </disk>
Nov 18 16:10:49 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:10:49 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdb from instance 081bc305-1c06-49b8-8520-a1d89be6af90 from the persistent domain config.
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 081bc305-1c06-49b8-8520-a1d89be6af90 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:10:49 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:10:49 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:10:49 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:10:49 user nova-compute[74839]:   <serial>d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9</serial>
Nov 18 16:10:49 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 18 16:10:49 user nova-compute[74839]: </disk>
Nov 18 16:10:49 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[48300b0e-6d1f-4116-859a-8db6815f4aa9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260]
Nov 18 16:10:49 user nova-compute[74839]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643, portal: 172.16.0.220,3260] successful.
Nov 18 16:10:49 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d0006e8-48cd-4ee7-8a76-24001e455643 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ef7a4-dea8-4988-940d-5c630ccfe753]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] <== disconnect_volume: return (338ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'flavor' on Instance uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:10:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fb2b3b5b-57b0-4755-ac8c-f974e6436f70 tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:10:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:10:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:08 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 081bc305-1c06-49b8-8520-a1d89be6af90 is timed out.
Nov 18 16:11:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdb from instance 081bc305-1c06-49b8-8520-a1d89be6af90 from the live domain config.
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZetzbGxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:11:09 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[296309c5-c4cb-41b5-8b75-843a24093e0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:11:09 user nova-compute[74839]: No targets found.
Nov 18 16:11:09 user nova-compute[74839]: iSNS:
Nov 18 16:11:09 user nova-compute[74839]: No targets found.
Nov 18 16:11:09 user nova-compute[74839]: STATIC:
Nov 18 16:11:09 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9
Nov 18 16:11:09 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:11:09 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:11:09 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:11:09 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:11:09 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:11:09 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00
Nov 18 16:11:09 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:11:09 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:11:09 user nova-compute[74839]: FIRMWARE:
Nov 18 16:11:09 user nova-compute[74839]: No targets found.
Nov 18 16:11:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:11:09 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:11:09 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880ae39-5346-45d0-8b3e-551d3b4b6b79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f5785f-8dc9-4102-922d-2caee9102400]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:11:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a017f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e80d7-86b4-4cf2-8697-7eaf785c2cbb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c1f9dc-bfbb-4691-8d1c-af63998dbffc]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e57519-47d6-46fe-9aef-d069621f65e6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e0887-f61a-43c2-ae5b-4d18f94fc09c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9651b0-46a4-404e-9785-14ef42d8c22d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d6ed7-004c-4609-afe1-e8034f2400e9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260]
Nov 18 16:11:09 user nova-compute[74839]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9, portal: 172.16.0.220,3260] successful.
Nov 18 16:11:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5de3bf6-3c80-405c-b8b8-302e0b1f7cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6996e-a1a9-49d4-9f63-eb7401117d1f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== disconnect_volume: return (366ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:11:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:11:10 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:11:10 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=25.102725982666016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-af6a4e28-590c-46f6-8b39-b9eb29bbb049 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f68cdc54-c399-4c74-952a-f5abdfbc6816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance ab853461-8060-4dca-b2db-8032b1a93db8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:11:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74839) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.objects.instance [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:11 user nova-compute[74839]: DEBUG nova.compute.manager [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:11 user nova-compute[74839]: WARNING nova.compute.manager [req-bc85746d-6bb2-42b1-824a-1642db95036a req-5eb8b126-af7b-4947-9680-249085eacebe service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state active and task_state powering-off.
Nov 18 16:11:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance destroyed successfully.
Nov 18 16:11:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:11:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-9de777a8-0979-43be-9c33-c16b97341d95 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:13 user nova-compute[74839]: DEBUG nova.compute.manager [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:13 user nova-compute[74839]: WARNING nova.compute.manager [req-ff57f206-0cd2-4ba8-ab15-268bc490bccc req-0cd2dd76-6aa4-48b0-a020-12e6b04c11f3 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state stopped and task_state None.
Nov 18 16:11:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:11:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:20 user nova-compute[74839]: INFO nova.compute.manager [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Terminating instance
Nov 18 16:11:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:20 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.compute.manager [req-2dd56f36-e4c0-443d-9c30-cf68dc6b54f8 req-388d31f3-7a00-4e4b-835f-92f60efbd51c service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-unplugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:11:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Instance destroyed successfully.
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.objects.instance [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lazy-loading 'resources' on Instance uuid dd9a0804-e816-4d28-a5ca-062c0e5c60c0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1314980537',display_name='tempest-TestMinimumBasicScenario-server-1314980537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1314980537',id=49,image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXx1/EY8zoxO+rKgsxa3TVjZ8OsA4q4ZkafKOtM0ujd4/1JlSN8Z2MPN1PqBmzyoINGSKX5R3VjUnLFSuXCY84rTIR8TZO9FQOPijbJYEybigW6GVzijiS4avrDTKD7Vg==',key_name='tempest-TestMinimumBasicScenario-925404096',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:06:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eebaec30e6d43a7aa4ba5aa548d3954',ramdisk_id='',reservation_id='r-is0528cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d72c247-e8ea-481f-aea4-84e249aef672',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-147307032',owner_user_name='tempest-TestMinimumBasicScenario-147307032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:08:43Z,user_data=None,user_id='f71eb7e6ae7f4f399d08eeb9ebc98097',uuid=dd9a0804-e816-4d28-a5ca-062c0e5c60c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converting VIF {"id": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "address": "fa:16:3e:e3:7f:ae", "network": {"id": "0cd2b880-8eca-40b1-840f-b60684d0497a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639590829-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eebaec30e6d43a7aa4ba5aa548d3954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3777c4-d3", "ovs_interfaceid": "7a3777c4-d3ff-4339-b771-0b2f565332d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG os_vif [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3777c4-d3, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03a8df5b-29e2-4939-bee0-59202247dcbe) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:21 user nova-compute[74839]: INFO os_vif [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:7f:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a3777c4-d3ff-4339-b771-0b2f565332d5,network=Network(0cd2b880-8eca-40b1-840f-b60684d0497a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3777c4-d3')
Nov 18 16:11:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Deleting instance files /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0_del
Nov 18 16:11:21 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Deletion of /opt/stack/data/nova/instances/dd9a0804-e816-4d28-a5ca-062c0e5c60c0_del complete
Nov 18 16:11:21 user nova-compute[74839]: INFO nova.compute.manager [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 18 16:11:21 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:11:21 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:11:22 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:22 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Took 0.38 seconds to deallocate network for instance.
Nov 18 16:11:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:22 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:11:22 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:11:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:22 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Deleted allocations for instance dd9a0804-e816-4d28-a5ca-062c0e5c60c0
Nov 18 16:11:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-348c8ff0-3ffd-41b7-aeb0-99716581f58f tempest-TestMinimumBasicScenario-147307032 tempest-TestMinimumBasicScenario-147307032-project-member] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.614s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] Acquiring lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] Lock "dd9a0804-e816-4d28-a5ca-062c0e5c60c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] No waiting events found dispatching network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:23 user nova-compute[74839]: WARNING nova.compute.manager [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received unexpected event network-vif-plugged-7a3777c4-d3ff-4339-b771-0b2f565332d5 for instance with vm_state deleted and task_state None.
Nov 18 16:11:23 user nova-compute[74839]: DEBUG nova.compute.manager [req-bccdb3cb-df31-496e-befd-c8bdf3932d6d req-d8a4d2a8-3ea5-4cf6-b7b2-d1edd7ad8abf service nova] [instance: dd9a0804-e816-4d28-a5ca-062c0e5c60c0] Received event network-vif-deleted-7a3777c4-d3ff-4339-b771-0b2f565332d5 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-changed-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing instance network info cache due to event network-changed-c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] Acquiring lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] Acquired lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:11:51 user nova-compute[74839]: DEBUG nova.network.neutron [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing network info cache for port c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updated VIF entry in instance network info cache for port c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-586bdacc-5486-40ac-a631-80a15813dfd8 req-c82438b4-aadf-48ba-9701-a322c525d8f3 service nova] Releasing lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-changed-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing instance network info cache due to event network-changed-c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] Acquiring lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] Acquired lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.network.neutron [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Refreshing network info cache for port c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:52 user nova-compute[74839]: INFO nova.compute.manager [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Terminating instance
Nov 18 16:11:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:52 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updated VIF entry in instance network info cache for port c685abfd-0fef-431a-b75d-7603dba75377. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.network.neutron [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [{"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-49a14e7e-9372-4715-8373-9aef77c08129 req-a976404f-7323-4143-ae28-4610f490b55d service nova] Releasing lock "refresh_cache-ab853461-8060-4dca-b2db-8032b1a93db8" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:11:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Instance destroyed successfully.
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.objects.instance [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid ab853461-8060-4dca-b2db-8032b1a93db8 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927748780',display_name='tempest-TestVolumeBootPattern-server-927748780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927748780',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-a3jfkbd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:10:12Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=ab853461-8060-4dca-b2db-8032b1a93db8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "c685abfd-0fef-431a-b75d-7603dba75377", "address": "fa:16:3e:1c:43:65", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc685abfd-0f", "ovs_interfaceid": "c685abfd-0fef-431a-b75d-7603dba75377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_vif [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc685abfd-0f, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cbee032-ad38-4d54-bf45-9e7235bae05d) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:53 user nova-compute[74839]: INFO os_vif [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:43:65,bridge_name='br-int',has_traffic_filtering=True,id=c685abfd-0fef-431a-b75d-7603dba75377,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc685abfd-0f')
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmqVMOjn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:11:53 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd07ef-f5e2-4126-997e-486ec27a8a87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:11:53 user nova-compute[74839]: No targets found.
Nov 18 16:11:53 user nova-compute[74839]: iSNS:
Nov 18 16:11:53 user nova-compute[74839]: No targets found.
Nov 18 16:11:53 user nova-compute[74839]: STATIC:
Nov 18 16:11:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:11:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:11:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:11:53 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00
Nov 18 16:11:53 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:11:53 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:11:53 user nova-compute[74839]: FIRMWARE:
Nov 18 16:11:53 user nova-compute[74839]: No targets found.
Nov 18 16:11:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:11:53 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:11:53 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[319eab7d-727e-4b90-9d13-5e9f43a643a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a004852d-091f-4b61-8bc9-a901093756ed]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:11:53 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:11:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:11:53 user nova-compute[74839]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 (non-flash)
Nov 18 16:11:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c55c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00'): ({'sde'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sde {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ee307-0ddb-4d8a-9865-0ce90a867db4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab340626-b3c9-4b76-95fc-689c9258501a]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sde {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d0ae3e-6065-432d-8faf-fe5a556aaf46]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d836426-e8c4-4c17-98e6-1005daf2ec2b]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sde have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc8fc7-72c1-4fde-8854-f2247e7503f0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dff12d-24c1-4e5b-9dcf-af9ec20bb06f]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260]
Nov 18 16:11:53 user nova-compute[74839]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00, portal: 172.16.0.220,3260] successful.
Nov 18 16:11:53 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048deca3-eb2a-4278-b365-460bb59f0f00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ab022-1974-4c19-884f-ee0a15aea51b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (300ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:11:53 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:11:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Deleting instance files /opt/stack/data/nova/instances/ab853461-8060-4dca-b2db-8032b1a93db8_del
Nov 18 16:11:53 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Deletion of /opt/stack/data/nova/instances/ab853461-8060-4dca-b2db-8032b1a93db8_del complete
Nov 18 16:11:54 user nova-compute[74839]: INFO nova.compute.manager [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:54 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Took 0.40 seconds to deallocate network for instance.
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-e63be9a8-c4f6-4cc4-8e69-76e15f03e104 req-053a4eb3-8f6f-4608-9b7e-ac3fdffcd37a service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-deleted-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:54 user nova-compute[74839]: INFO nova.compute.manager [req-e63be9a8-c4f6-4cc4-8e69-76e15f03e104 req-053a4eb3-8f6f-4608-9b7e-ac3fdffcd37a service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Neutron deleted interface c685abfd-0fef-431a-b75d-7603dba75377; detaching it from the instance and deleting it from the info cache
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.network.neutron [req-e63be9a8-c4f6-4cc4-8e69-76e15f03e104 req-053a4eb3-8f6f-4608-9b7e-ac3fdffcd37a service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-e63be9a8-c4f6-4cc4-8e69-76e15f03e104 req-053a4eb3-8f6f-4608-9b7e-ac3fdffcd37a service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Detach interface failed, port_id=c685abfd-0fef-431a-b75d-7603dba75377, reason: Instance ab853461-8060-4dca-b2db-8032b1a93db8 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-unplugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] No waiting events found dispatching network-vif-unplugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-unplugged-c685abfd-0fef-431a-b75d-7603dba75377 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Acquiring lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] Lock "ab853461-8060-4dca-b2db-8032b1a93db8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:54 user nova-compute[74839]: DEBUG nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] No waiting events found dispatching network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:11:54 user nova-compute[74839]: WARNING nova.compute.manager [req-9c3fe8c9-83ab-4203-91e1-1e208a107d4d req-a0e4cc9a-b771-43c0-9ddd-af9cff561a04 service nova] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Received unexpected event network-vif-plugged-c685abfd-0fef-431a-b75d-7603dba75377 for instance with vm_state active and task_state deleting.
Nov 18 16:11:55 user nova-compute[74839]: INFO nova.compute.manager [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: ab853461-8060-4dca-b2db-8032b1a93db8] Took 0.71 seconds to detach 1 volumes for instance.
Nov 18 16:11:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:11:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:11:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:11:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:11:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:55 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance ab853461-8060-4dca-b2db-8032b1a93db8
Nov 18 16:11:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-7802b372-57ca-4f4e-aa30-1f40386d4a3e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "ab853461-8060-4dca-b2db-8032b1a93db8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:11:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:11:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:05 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:12:08 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:12:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.129547119140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance f68cdc54-c399-4c74-952a-f5abdfbc6816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:12:09 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:12:10 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:12:10 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:12:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:12:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:15 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:12:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:32 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-changed-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing instance network info cache due to event network-changed-593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] Acquiring lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] Acquired lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Refreshing network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:49 user nova-compute[74839]: INFO nova.compute.manager [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Terminating instance
Nov 18 16:12:49 user nova-compute[74839]: DEBUG nova.compute.manager [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updated VIF entry in instance network info cache for port 593160b6-509a-484f-bbfd-490df84da0ec. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.network.neutron [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [{"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-62bdca70-3ef0-4fff-b31e-082e7a23e460 req-ce180541-0064-410f-91cb-6880825e879a service nova] Releasing lock "refresh_cache-f68cdc54-c399-4c74-952a-f5abdfbc6816" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-unplugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] No waiting events found dispatching network-vif-unplugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.compute.manager [req-30c15bfc-1186-4a69-ac10-3bd03348099b req-3775ce42-1c82-4994-929a-d62bc656290c service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-unplugged-593160b6-509a-484f-bbfd-490df84da0ec for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Instance destroyed successfully.
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.objects.instance [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lazy-loading 'resources' on Instance uuid f68cdc54-c399-4c74-952a-f5abdfbc6816 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-259005468',display_name='tempest-TestVolumeBootPattern-server-259005468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-259005468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIolChtoPMVFpxPPcTzWChqUDK3tPYm8InosrhMXCqmFPBU/oiq+m89RkUu2cuRXhlQNNUFible+lGUmll3tkqhSsplP1DLAJAdjs1KqS24ZFH5thfxwZGlIjYLYwfigsA==',key_name='tempest-TestVolumeBootPattern-1706975110',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1ac31c8bb643b6a6cab7d0c06d227d',ramdisk_id='',reservation_id='r-or40w05f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1298499824',owner_user_name='tempest-TestVolumeBootPattern-1298499824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:08:13Z,user_data=None,user_id='e6345d428e0246f1b6120c19b5b4c72c',uuid=f68cdc54-c399-4c74-952a-f5abdfbc6816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converting VIF {"id": "593160b6-509a-484f-bbfd-490df84da0ec", "address": "fa:16:3e:22:d8:00", "network": {"id": "020d7989-5fbd-459b-a890-770df7f127e3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1958128061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f1ac31c8bb643b6a6cab7d0c06d227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap593160b6-50", "ovs_interfaceid": "593160b6-509a-484f-bbfd-490df84da0ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_vif [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap593160b6-50, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=645524d4-d805-4d1e-b0b6-59c58339d3da) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:50 user nova-compute[74839]: INFO os_vif [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d8:00,bridge_name='br-int',has_traffic_filtering=True,id=593160b6-509a-484f-bbfd-490df84da0ec,network=Network(020d7989-5fbd-459b-a890-770df7f127e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap593160b6-50')
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MBsrpcdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:12:50 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205920e-578a-41c1-9226-2072392a0388]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:12:50 user nova-compute[74839]: No targets found.
Nov 18 16:12:50 user nova-compute[74839]: iSNS:
Nov 18 16:12:50 user nova-compute[74839]: No targets found.
Nov 18 16:12:50 user nova-compute[74839]: STATIC:
Nov 18 16:12:50 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59
Nov 18 16:12:50 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:12:50 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:12:50 user nova-compute[74839]: FIRMWARE:
Nov 18 16:12:50 user nova-compute[74839]: No targets found.
Nov 18 16:12:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:12:50 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:12:50 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4121df5-3530-4148-b511-72de7f56d663]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f25565-e5f7-439f-a06e-cab2fd804a64]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:12:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 (non-flash)
Nov 18 16:12:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c6fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6321cdce-747a-4186-89b7-1ef7ca4d6183]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46fa9ac-df21-49f1-b8ce-f91dcf3ca564]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd2cc7-70b4-4640-ab18-d218f4c022eb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[522516df-a538-4ff8-ad7c-a49ecd29bfa9]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9001bef-0863-44bf-9c29-509fb7acfb88]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a5611-78e2-4bdc-9346-ba6246a8c37c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260]
Nov 18 16:12:50 user nova-compute[74839]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59, portal: 172.16.0.220,3260] successful.
Nov 18 16:12:50 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e33e344-4ffc-4252-9667-01573d718c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f08df7-eb31-481c-b552-3439bd818c45]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] <== disconnect_volume: return (299ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:12:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Deleting instance files /opt/stack/data/nova/instances/f68cdc54-c399-4c74-952a-f5abdfbc6816_del
Nov 18 16:12:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Deletion of /opt/stack/data/nova/instances/f68cdc54-c399-4c74-952a-f5abdfbc6816_del complete
Nov 18 16:12:50 user nova-compute[74839]: INFO nova.compute.manager [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 18 16:12:50 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:12:50 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:12:51 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:12:51 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Took 0.46 seconds to deallocate network for instance.
Nov 18 16:12:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-9cd13191-1bef-4ef9-ae91-c43e27ec604d req-ae15dd22-719b-4643-8c60-0f2d8a7c640f service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-deleted-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:12:52 user nova-compute[74839]: INFO nova.compute.manager [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Took 0.74 seconds to detach 1 volumes for instance.
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] Acquiring lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG nova.compute.manager [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] No waiting events found dispatching network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:12:52 user nova-compute[74839]: WARNING nova.compute.manager [req-4d913941-f8ad-4ce3-9bd0-b74b055ee1de req-613024f7-7db2-4965-a6e2-6f079d8f1078 service nova] [instance: f68cdc54-c399-4c74-952a-f5abdfbc6816] Received unexpected event network-vif-plugged-593160b6-509a-484f-bbfd-490df84da0ec for instance with vm_state deleted and task_state None.
Nov 18 16:12:52 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:52 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Deleted allocations for instance f68cdc54-c399-4c74-952a-f5abdfbc6816
Nov 18 16:12:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-6d355293-8a3f-41f3-bdb0-9b2ecc335c6e tempest-TestVolumeBootPattern-1298499824 tempest-TestVolumeBootPattern-1298499824-project-member] Lock "f68cdc54-c399-4c74-952a-f5abdfbc6816" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:12:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:13:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.neutron [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:13:02 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance destroyed successfully.
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'resources' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG os_vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5982d76d-b4, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5300740d-9b75-4a01-b89c-dba2ac737fe9) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:02 user nova-compute[74839]: INFO os_vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start _get_guest_xml network_info=[{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'numa_topology' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:13:02 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'pci_devices' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:13:02 user nova-compute[74839]:   <uuid>081bc305-1c06-49b8-8520-a1d89be6af90</uuid>
Nov 18 16:13:02 user nova-compute[74839]:   <name>instance-0000002f</name>
Nov 18 16:13:02 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:13:02 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:13:02 user nova-compute[74839]:   <metadata>
Nov 18 16:13:02 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:13:02 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeTestJSON-server-1557433728</nova:name>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:13:02</nova:creationTime>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:13:02 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:13:02 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:owner>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:user uuid="d2c0abdcb59a49a5b5aae8f0ef925f27">tempest-AttachVolumeTestJSON-689484882-project-member</nova:user>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:project uuid="39ae89917b5d41f5bc1216f055dc263d">tempest-AttachVolumeTestJSON-689484882</nova:project>
Nov 18 16:13:02 user nova-compute[74839]:       </nova:owner>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:13:02 user nova-compute[74839]:       <nova:ports>
Nov 18 16:13:02 user nova-compute[74839]:         <nova:port uuid="5982d76d-b425-4dc7-acd7-d2621f24f57e">
Nov 18 16:13:02 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 16:13:02 user nova-compute[74839]:         </nova:port>
Nov 18 16:13:02 user nova-compute[74839]:       </nova:ports>
Nov 18 16:13:02 user nova-compute[74839]:     </nova:instance>
Nov 18 16:13:02 user nova-compute[74839]:   </metadata>
Nov 18 16:13:02 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:13:02 user nova-compute[74839]:     <system>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="serial">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="uuid">081bc305-1c06-49b8-8520-a1d89be6af90</entry>
Nov 18 16:13:02 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:13:02 user nova-compute[74839]:     </system>
Nov 18 16:13:02 user nova-compute[74839]:   </sysinfo>
Nov 18 16:13:02 user nova-compute[74839]:   <os>
Nov 18 16:13:02 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:13:02 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:13:02 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:13:02 user nova-compute[74839]:   </os>
Nov 18 16:13:02 user nova-compute[74839]:   <features>
Nov 18 16:13:02 user nova-compute[74839]:     <acpi/>
Nov 18 16:13:02 user nova-compute[74839]:     <apic/>
Nov 18 16:13:02 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:13:02 user nova-compute[74839]:   </features>
Nov 18 16:13:02 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:13:02 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:13:02 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:13:02 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:13:02 user nova-compute[74839]:   </clock>
Nov 18 16:13:02 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:13:02 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:13:02 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:13:02 user nova-compute[74839]:   </cpu>
Nov 18 16:13:02 user nova-compute[74839]:   <devices>
Nov 18 16:13:02 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:13:02 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:13:02 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk"/>
Nov 18 16:13:02 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:13:02 user nova-compute[74839]:     </disk>
Nov 18 16:13:02 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:13:02 user nova-compute[74839]:       <mac address="fa:16:3e:fd:02:fb"/>
Nov 18 16:13:02 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:13:02 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:13:02 user nova-compute[74839]:       <target dev="tap5982d76d-b4"/>
Nov 18 16:13:02 user nova-compute[74839]:     </interface>
Nov 18 16:13:02 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:13:02 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/console.log" append="off"/>
Nov 18 16:13:02 user nova-compute[74839]:     </serial>
Nov 18 16:13:02 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:13:02 user nova-compute[74839]:     <video>
Nov 18 16:13:02 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:13:02 user nova-compute[74839]:     </video>
Nov 18 16:13:02 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:13:02 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:13:02 user nova-compute[74839]:     </rng>
Nov 18 16:13:02 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:13:02 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:13:02 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:13:02 user nova-compute[74839]:     </memballoon>
Nov 18 16:13:02 user nova-compute[74839]:   </devices>
Nov 18 16:13:02 user nova-compute[74839]: </domain>
Nov 18 16:13:02 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:13:02 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Cannot resize image /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.objects.instance [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'migration_context' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.objects.base [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Object Instance<081bc305-1c06-49b8-8520-a1d89be6af90> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74839) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG os_vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38ff6ea8-13c7-5e86-8aab-d43756053a54', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5982d76d-b4, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5982d76d-b4, col_values=(('qos', UUID('4ea9bb69-1a92-4a23-b583-327b30254a4f')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5982d76d-b4, col_values=(('external_ids', {'iface-id': '5982d76d-b425-4dc7-acd7-d2621f24f57e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:02:fb', 'vm-uuid': '081bc305-1c06-49b8-8520-a1d89be6af90'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:03 user nova-compute[74839]: INFO os_vif [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:13:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG nova.compute.manager [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:13:05 user nova-compute[74839]: WARNING nova.compute.manager [req-45b25063-0429-4762-a5a2-28e46852a3ba req-c7b72ccc-6ff0-4bc3-a512-bc3c674045af service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state stopped and task_state powering-on.
Nov 18 16:13:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:05 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:06 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:13:06 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:13:07 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance rebooted successfully.
Nov 18 16:13:07 user nova-compute[74839]: DEBUG nova.compute.manager [None req-ce45ad41-4b60-4876-8b2a-eb2bd4ebfbfb tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:13:07 user nova-compute[74839]: DEBUG nova.compute.manager [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:13:07 user nova-compute[74839]: WARNING nova.compute.manager [req-b5a5a0ef-0246-4015-9dbc-a50bce15136e req-33f5181d-0118-4a76-a993-c1861fc6a19f service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state active and task_state None.
Nov 18 16:13:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:10 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:13:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:13:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:13:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9018MB free_disk=25.166969299316406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:13:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:13:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:15 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:15 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:13:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:33 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:13:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:40 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:13:58 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:03 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:07 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:08 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:14:11 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [{"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-081bc305-1c06-49b8-8520-a1d89be6af90" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:14:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:14:13 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:14:13 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.15774154663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 081bc305-1c06-49b8-8520-a1d89be6af90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:14:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:23 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:28 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:33 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:38 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:43 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:14:48 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:53 user nova-compute[74839]: INFO nova.compute.manager [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Terminating instance
Nov 18 16:14:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:14:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-c8b3a9c3-6215-441c-aa41-8b623c3c698d req-0da29c35-c10d-4b30-b3c9-39253bb0da22 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-unplugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Instance destroyed successfully.
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.objects.instance [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'resources' on Instance uuid 081bc305-1c06-49b8-8520-a1d89be6af90 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1557433728',display_name='tempest-AttachVolumeTestJSON-server-1557433728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1557433728',id=47,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc3yziWbyucFUOElKQdGG7PTiGLIwIO6po7wYuy6SOatHQK5Jt6U89TXq9geMVVPvyB1UwZCOa3fSLfceeBaQ03YGofHDVkPpGlDb9SCegCSOtOhISdjuZDpfnmlcS3fQ==',key_name='tempest-keypair-487763189',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-sgz70z3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=081bc305-1c06-49b8-8520-a1d89be6af90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "address": "fa:16:3e:fd:02:fb", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5982d76d-b4", "ovs_interfaceid": "5982d76d-b425-4dc7-acd7-d2621f24f57e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG os_vif [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5982d76d-b4, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ea9bb69-1a92-4a23-b583-327b30254a4f) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:14:54 user nova-compute[74839]: INFO os_vif [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:02:fb,bridge_name='br-int',has_traffic_filtering=True,id=5982d76d-b425-4dc7-acd7-d2621f24f57e,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5982d76d-b4')
Nov 18 16:14:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Deleting instance files /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90_del
Nov 18 16:14:54 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Deletion of /opt/stack/data/nova/instances/081bc305-1c06-49b8-8520-a1d89be6af90_del complete
Nov 18 16:14:54 user nova-compute[74839]: INFO nova.compute.manager [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 18 16:14:54 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:14:54 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:14:55 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Took 1.11 seconds to deallocate network for instance.
Nov 18 16:14:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG nova.compute.manager [req-f3c4d3a8-02ce-4243-99f4-4c63de93db3a req-bf543df6-1e88-4591-a4c1-89f744eae650 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-deleted-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:14:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:55 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Deleted allocations for instance 081bc305-1c06-49b8-8520-a1d89be6af90
Nov 18 16:14:55 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-d75f23ca-986b-4252-aedc-aa34a44970d2 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "081bc305-1c06-49b8-8520-a1d89be6af90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.282s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:14:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] Acquiring lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:14:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:14:56 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] Lock "081bc305-1c06-49b8-8520-a1d89be6af90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:14:56 user nova-compute[74839]: DEBUG nova.compute.manager [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] No waiting events found dispatching network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:14:56 user nova-compute[74839]: WARNING nova.compute.manager [req-9115a665-1837-4b12-8dde-191256d4fb77 req-79c120ff-e634-4e14-83be-d60066324c12 service nova] [instance: 081bc305-1c06-49b8-8520-a1d89be6af90] Received unexpected event network-vif-plugged-5982d76d-b425-4dc7-acd7-d2621f24f57e for instance with vm_state deleted and task_state None.
Nov 18 16:14:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:14:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:09 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:15:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:15:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9147MB free_disk=25.18526840209961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:15:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:15:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:15:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:15:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:15:47 user nova-compute[74839]: INFO nova.compute.claims [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Claim successful on node user
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:15:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.policy [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2c0abdcb59a49a5b5aae8f0ef925f27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae89917b5d41f5bc1216f055dc263d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:15:47 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Creating image(s)
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "/opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "/opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "/opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.164s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk 1073741824" returned: 0 in 0.051s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Successfully created port: e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Cannot resize image /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Ensure instance console log exists: /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Successfully updated port: e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-changed-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.compute.manager [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Refreshing instance network info cache due to event network-changed-e4c9d2d2-58dc-4978-b8fe-aeff2f017429. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Instance network_info: |[{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Refreshing network info cache for port e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Start _get_guest_xml network_info=[{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:15:49 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:15:49 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-129612806',display_name='tempest-AttachVolumeTestJSON-server-129612806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-129612806',id=52,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa+K082cDaGS+5iGbO6kkRhS3qhQHz4cDdWD09MSAACOcPYe3OXkt+FP+3qcw9v0dq52byGzCHa11DT+NryaHf0Xbkh64bJsrXyE3tKnlsoZsb7VqaHR5iLqEfqvdjgIw==',key_name='tempest-keypair-82897199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-5qbni4ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=70e4833a-d8db-4538-85a5-bce7e252a0c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'pci_devices' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:15:49 user nova-compute[74839]:   <uuid>70e4833a-d8db-4538-85a5-bce7e252a0c7</uuid>
Nov 18 16:15:49 user nova-compute[74839]:   <name>instance-00000034</name>
Nov 18 16:15:49 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:15:49 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:15:49 user nova-compute[74839]:   <metadata>
Nov 18 16:15:49 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:15:49 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:name>tempest-AttachVolumeTestJSON-server-129612806</nova:name>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:15:49</nova:creationTime>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:15:49 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:15:49 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:owner>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:user uuid="d2c0abdcb59a49a5b5aae8f0ef925f27">tempest-AttachVolumeTestJSON-689484882-project-member</nova:user>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:project uuid="39ae89917b5d41f5bc1216f055dc263d">tempest-AttachVolumeTestJSON-689484882</nova:project>
Nov 18 16:15:49 user nova-compute[74839]:       </nova:owner>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:15:49 user nova-compute[74839]:       <nova:ports>
Nov 18 16:15:49 user nova-compute[74839]:         <nova:port uuid="e4c9d2d2-58dc-4978-b8fe-aeff2f017429">
Nov 18 16:15:49 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 18 16:15:49 user nova-compute[74839]:         </nova:port>
Nov 18 16:15:49 user nova-compute[74839]:       </nova:ports>
Nov 18 16:15:49 user nova-compute[74839]:     </nova:instance>
Nov 18 16:15:49 user nova-compute[74839]:   </metadata>
Nov 18 16:15:49 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:15:49 user nova-compute[74839]:     <system>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="serial">70e4833a-d8db-4538-85a5-bce7e252a0c7</entry>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="uuid">70e4833a-d8db-4538-85a5-bce7e252a0c7</entry>
Nov 18 16:15:49 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:15:49 user nova-compute[74839]:     </system>
Nov 18 16:15:49 user nova-compute[74839]:   </sysinfo>
Nov 18 16:15:49 user nova-compute[74839]:   <os>
Nov 18 16:15:49 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:15:49 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:15:49 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:15:49 user nova-compute[74839]:   </os>
Nov 18 16:15:49 user nova-compute[74839]:   <features>
Nov 18 16:15:49 user nova-compute[74839]:     <acpi/>
Nov 18 16:15:49 user nova-compute[74839]:     <apic/>
Nov 18 16:15:49 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:15:49 user nova-compute[74839]:   </features>
Nov 18 16:15:49 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:15:49 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:15:49 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:15:49 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:15:49 user nova-compute[74839]:   </clock>
Nov 18 16:15:49 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:15:49 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:15:49 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:15:49 user nova-compute[74839]:   </cpu>
Nov 18 16:15:49 user nova-compute[74839]:   <devices>
Nov 18 16:15:49 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:15:49 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:15:49 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk"/>
Nov 18 16:15:49 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:15:49 user nova-compute[74839]:     </disk>
Nov 18 16:15:49 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:15:49 user nova-compute[74839]:       <mac address="fa:16:3e:a4:41:a0"/>
Nov 18 16:15:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:15:49 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:15:49 user nova-compute[74839]:       <target dev="tape4c9d2d2-58"/>
Nov 18 16:15:49 user nova-compute[74839]:     </interface>
Nov 18 16:15:49 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:15:49 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/console.log" append="off"/>
Nov 18 16:15:49 user nova-compute[74839]:     </serial>
Nov 18 16:15:49 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:15:49 user nova-compute[74839]:     <video>
Nov 18 16:15:49 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:15:49 user nova-compute[74839]:     </video>
Nov 18 16:15:49 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:15:49 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:15:49 user nova-compute[74839]:     </rng>
Nov 18 16:15:49 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:15:49 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:15:49 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:15:49 user nova-compute[74839]:     </memballoon>
Nov 18 16:15:49 user nova-compute[74839]:   </devices>
Nov 18 16:15:49 user nova-compute[74839]: </domain>
Nov 18 16:15:49 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-129612806',display_name='tempest-AttachVolumeTestJSON-server-129612806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-129612806',id=52,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa+K082cDaGS+5iGbO6kkRhS3qhQHz4cDdWD09MSAACOcPYe3OXkt+FP+3qcw9v0dq52byGzCHa11DT+NryaHf0Xbkh64bJsrXyE3tKnlsoZsb7VqaHR5iLqEfqvdjgIw==',key_name='tempest-keypair-82897199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-5qbni4ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=70e4833a-d8db-4538-85a5-bce7e252a0c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG os_vif [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5526867-59b1-5b33-8325-4336ecd8610c', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4c9d2d2-58, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4c9d2d2-58, col_values=(('qos', UUID('c755cdb3-c1de-4cf1-bfc4-aac3006b2cd8')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4c9d2d2-58, col_values=(('external_ids', {'iface-id': 'e4c9d2d2-58dc-4978-b8fe-aeff2f017429', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:41:a0', 'vm-uuid': '70e4833a-d8db-4538-85a5-bce7e252a0c7'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:49 user nova-compute[74839]: INFO os_vif [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58')
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No VIF found with MAC fa:16:3e:a4:41:a0, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updated VIF entry in instance network info cache for port e4c9d2d2-58dc-4978-b8fe-aeff2f017429. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG nova.network.neutron [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:15:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-3be9ff7e-3c61-4681-8571-af788d70f00c req-0a5b97d5-d0f0-4dcd-bedc-381c9e5e4443 service nova] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:15:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:50 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG nova.compute.manager [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] No waiting events found dispatching network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:15:51 user nova-compute[74839]: WARNING nova.compute.manager [req-fe955f8f-3bfb-4346-b3b2-a822f0982508 req-383889b0-6fd0-486e-841a-685bef9e26f8 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received unexpected event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 for instance with vm_state building and task_state spawning.
Nov 18 16:15:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:15:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Instance spawned successfully.
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:15:53 user nova-compute[74839]: INFO nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 18 16:15:53 user nova-compute[74839]: DEBUG nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:15:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:15:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:15:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:15:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:53 user nova-compute[74839]: DEBUG nova.compute.manager [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] No waiting events found dispatching network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:15:53 user nova-compute[74839]: WARNING nova.compute.manager [req-b6305597-d2c8-4a65-900d-b53952771fd4 req-6e0cc0e4-3cc2-427e-9833-60bca27c9aa6 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received unexpected event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 for instance with vm_state building and task_state spawning.
Nov 18 16:15:53 user nova-compute[74839]: INFO nova.compute.manager [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Took 5.68 seconds to build instance.
Nov 18 16:15:53 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-71f15f50-3835-4f63-a862-5273e32e39e0 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.770s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:15:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:15:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:16:11 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:16:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:16:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.15697479248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:16:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:16:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:16:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:31 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:16:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:16:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:16:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:16:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:16:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:17:11 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:13 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:17:13 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.154895782470703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:17:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:17:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:17:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:14 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:17:15 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:17:15 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:17:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:17:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-changed-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG nova.compute.manager [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Refreshing instance network info cache due to event network-changed-e4c9d2d2-58dc-4978-b8fe-aeff2f017429. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Refreshing network info cache for port e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updated VIF entry in instance network info cache for port e4c9d2d2-58dc-4978-b8fe-aeff2f017429. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG nova.network.neutron [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:17:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-b5976ba7-a410-4270-b758-94d6bcbef3eb req-93402225-6afa-4f76-b75a-5b09ba020eed service nova] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:17:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:40 user nova-compute[74839]: DEBUG nova.objects.instance [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:17:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:41 user nova-compute[74839]: INFO nova.compute.manager [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attaching volume 69c0e49c-39e9-46cc-90ad-8ad8d77db32f to /dev/vdb
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5b0f2-6849-477b-b113-d401ca8dac96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc1ea6-6c12-4cb4-abba-31a08a58e3ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[948bdaa2-0346-4839-af7e-3e75cbf0283a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7233ee56-0dca-4ab8-b2c1-fc428251a1e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:17:41 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:17:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[46362363-dcba-4422-bcd2-d049381baf74]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating existing volume attachment record: b64cced2-26c3-4e2a-947d-1400c8d0e154 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:17:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFcNjfdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:17:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:17:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:17:47 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73bd709-f2c7-4175-8213-3bd8ebff3061]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:17:47 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8673ea8f-4e15-482d-9a58-d1199795acce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f] added
Nov 18 16:17:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd2539-053e-44ed-b6c5-816a6eabed67]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf30f0bb-eeb2-401d-b88d-582f541ba147]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFcNjfdO {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFcNjfdO" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a61473-9a52-46e8-923d-aadf4d803cbb]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFcNjfdO'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed0db5-8a44-44a8-a033-7f187cf22886]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[534d039f-bf61-43f8-a3a2-0aecf1ee3d20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:17:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:17:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:17:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:17:48 user nova-compute[74839]: 
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8d6fc-1c26-4ea7-acbe-d5d98217253f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260]
Nov 18 16:17:48 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260] successful.
Nov 18 16:17:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a776b46-bf05-4b5c-83f3-70eebd579f55]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[754d7949-e51e-40ba-ab41-22830dab68b1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[49752bf5-9bf9-4547-b00e-de2222b17db3]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:17:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFcNjfdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26137303738653433', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137303738653433', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:17:49 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:17:49 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:17:49 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:17:49 user nova-compute[74839]:   <serial>69c0e49c-39e9-46cc-90ad-8ad8d77db32f</serial>
Nov 18 16:17:49 user nova-compute[74839]: </disk>
Nov 18 16:17:49 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No VIF found with MAC fa:16:3e:a4:41:a0, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:17:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-02ccbbe7-0b4d-403b-b8c1-545c6d630a20 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.867s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:17:52 user nova-compute[74839]: INFO nova.compute.manager [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attaching volume 83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 to /dev/vdc
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.utils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b41b748-d018-48fc-bcde-75de485910eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b29c868-5ba9-4311-aeaf-247b3e4fb39b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52500ffa-cdf6-4b34-bafe-9fc445da6b92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf419098-e0c6-44a4-a6a3-9de196007340]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:17:52 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:17:52 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[61225bc4-93cd-4a38-bb1e-17db987eb1eb]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG os_brick.utils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:17:52 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating existing volume attachment record: 7e7f722b-cd6a-4f08-9f3a-51827e568d20 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:17:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:17:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfuZUpLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:17:57 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:17:57 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:17:57 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca226e2-c62c-4a5f-817a-1a802eea88c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:17:57 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fadfa1-8cff-4913-bf7b-217c981e374c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4] added
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d70fc-af1f-49a7-82be-5b9badd5aeb8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d0f2ba-89a7-4ad1-b511-7d6cbaf848bd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfuZUpLk {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfuZUpLk" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c7e0e-8edc-496a-9385-e789ed1d4b68]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfuZUpLk'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbcdf81-b659-4bbc-8500-8c8970f16b27]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88692c-2aae-4f00-8f7e-79b9092ba3c1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228049f-a476-46e4-98ae-d08c6f27d44d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260]
Nov 18 16:17:57 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260] successful.
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d7414-d0d7-45c3-a4e4-d989a746f26c]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced37de-3764-41f2-b8da-297f0499c7b7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:57 user nova-compute[74839]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:17:57 user nova-compute[74839]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:17:57 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:17:57 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df013b29-bd3e-44a2-afb3-aef259c94394]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:17:58 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfuZUpLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26139666633643038', 'path': '/dev/sdc'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139666633643038', 'path': '/dev/sdc'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.objects.instance [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:17:59 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:17:59 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:17:59 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 16:17:59 user nova-compute[74839]:   <serial>83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4</serial>
Nov 18 16:17:59 user nova-compute[74839]: </disk>
Nov 18 16:17:59 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] No VIF found with MAC fa:16:3e:a4:41:a0, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:17:59 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-2e9ffd88-b746-4932-ab56-dae8740ef4c7 tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.183s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:00 user nova-compute[74839]: INFO nova.compute.manager [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Detaching volume 69c0e49c-39e9-46cc-90ad-8ad8d77db32f
Nov 18 16:18:00 user nova-compute[74839]: INFO nova.virt.block_device [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attempting to driver detach volume 69c0e49c-39e9-46cc-90ad-8ad8d77db32f from mountpoint /dev/vdb
Nov 18 16:18:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Attempting to detach device vdb from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:18:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:18:00 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:18:00 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:18:00 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:18:00 user nova-compute[74839]:   <serial>69c0e49c-39e9-46cc-90ad-8ad8d77db32f</serial>
Nov 18 16:18:00 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:18:00 user nova-compute[74839]: </disk>
Nov 18 16:18:00 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:18:00 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdb from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the persistent domain config.
Nov 18 16:18:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:18:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:18:00 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:18:00 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:18:00 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:18:00 user nova-compute[74839]:   <serial>69c0e49c-39e9-46cc-90ad-8ad8d77db32f</serial>
Nov 18 16:18:00 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:18:00 user nova-compute[74839]: </disk>
Nov 18 16:18:00 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:18:00 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:18:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:18:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:18:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74839) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 18 16:18:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:18:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:18:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.153614044189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:18:16 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [{"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-70e4833a-d8db-4538-85a5-bce7e252a0c7" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:18:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 is timed out.
Nov 18 16:18:20 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdb from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the live domain config.
Nov 18 16:18:20 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:18:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFcNjfdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:18:20 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:18:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:18:20 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:18:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[de100384-9e33-43c4-ae04-2d493d30e3c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:18:21 user nova-compute[74839]: No targets found.
Nov 18 16:18:21 user nova-compute[74839]: iSNS:
Nov 18 16:18:21 user nova-compute[74839]: No targets found.
Nov 18 16:18:21 user nova-compute[74839]: STATIC:
Nov 18 16:18:21 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f
Nov 18 16:18:21 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:18:21 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:18:21 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4
Nov 18 16:18:21 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:18:21 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:18:21 user nova-compute[74839]: FIRMWARE:
Nov 18 16:18:21 user nova-compute[74839]: No targets found.
Nov 18 16:18:21 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:18:21 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:18:21 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[885aced2-e20e-46be-95b8-437be41bed47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ede5db-cc81-4378-b8d0-3cd7089162d0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:18:21 user nova-compute[74839]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:18:21 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f (non-flash)
Nov 18 16:18:21 user nova-compute[74839]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:18:21 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c6fdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8cbb78-861f-4fe9-a65a-b78ee20063c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae5966-f95f-408a-8b60-890e90355a90]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c0d8a-ab0f-46b7-80cd-14e1df720234]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[704333a8-cc89-40e8-85e8-cf4a0862759f]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6520bb6-0606-4f70-8fc1-49ea78e4319b]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a22bbd9-1d28-4cef-b13b-684d1d9a003a]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260]
Nov 18 16:18:21 user nova-compute[74839]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f, portal: 172.16.0.220,3260] successful.
Nov 18 16:18:21 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c0e49c-39e9-46cc-90ad-8ad8d77db32f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d2784-b85f-4fd5-9c4d-a7be29ea57d4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== disconnect_volume: return (307ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:18:21 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:18:22 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:18:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c4f565df-aeb9-4675-b587-b2d36fdaf56c tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.624s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:18:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:23 user nova-compute[74839]: INFO nova.compute.manager [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Detaching volume 83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4
Nov 18 16:18:23 user nova-compute[74839]: INFO nova.virt.block_device [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Attempting to driver detach volume 83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 from mountpoint /dev/vdc
Nov 18 16:18:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Attempting to detach device vdc from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:18:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:18:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:18:23 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:18:23 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 16:18:23 user nova-compute[74839]:   <serial>83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4</serial>
Nov 18 16:18:23 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 16:18:23 user nova-compute[74839]: </disk>
Nov 18 16:18:23 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:18:23 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdc from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the persistent domain config.
Nov 18 16:18:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:18:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:18:23 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:18:23 user nova-compute[74839]:   <source dev="/dev/sdc"/>
Nov 18 16:18:23 user nova-compute[74839]:   <target dev="vdc" bus="virtio"/>
Nov 18 16:18:23 user nova-compute[74839]:   <serial>83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4</serial>
Nov 18 16:18:23 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 18 16:18:23 user nova-compute[74839]: </disk>
Nov 18 16:18:23 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:18:23 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:18:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:18:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:34 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:18:43 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 is timed out.
Nov 18 16:18:43 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully detached device vdc from instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 from the live domain config.
Nov 18 16:18:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfuZUpLk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:18:43 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be9c16-286a-4389-8e79-37e92d912f65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:18:43 user nova-compute[74839]: No targets found.
Nov 18 16:18:43 user nova-compute[74839]: iSNS:
Nov 18 16:18:43 user nova-compute[74839]: No targets found.
Nov 18 16:18:43 user nova-compute[74839]: STATIC:
Nov 18 16:18:43 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4
Nov 18 16:18:43 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:18:43 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:18:43 user nova-compute[74839]: FIRMWARE:
Nov 18 16:18:43 user nova-compute[74839]: No targets found.
Nov 18 16:18:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:18:43 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:18:43 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd5f293-3896-47e1-b5cd-b74c51db6c10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea2043-87c4-4efc-97cf-bbfd953fe498]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:18:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 (non-flash)
Nov 18 16:18:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49829dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4'): ({'sdc'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Removing single pathed devices sdc {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a77e39-fd53-42a7-ad26-ad205d83c0db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5293fb3-834d-4067-9f6d-3eca3b153dee]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Flushing IO for device /dev/sdc {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b6b7ff-3bf1-4eb4-8e4f-9864102c54dd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e946d5a-8c15-4a22-b404-7539d9ce418c]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] SCSI volumes sdc have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0e08c-cebc-4ea2-a205-ee15d934002f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d71d4be-5beb-442d-b0fd-9f58e9b4eb8d]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260]
Nov 18 16:18:43 user nova-compute[74839]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4, portal: 172.16.0.220,3260] successful.
Nov 18 16:18:43 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83b81bbe-e90e-4a7d-bbc9-2be332e7c9a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1226ab7-398b-44ff-8732-36dcb9bb90b5]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] <== disconnect_volume: return (311ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:18:43 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:18:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:18:44 user nova-compute[74839]: DEBUG nova.objects.instance [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'flavor' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:18:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-cac677a5-8876-4b31-8fb3-8fee0e7476aa tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:46 user nova-compute[74839]: INFO nova.compute.manager [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Terminating instance
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.compute.manager [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-unplugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] No waiting events found dispatching network-vif-unplugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.compute.manager [req-2c6dd643-7181-4a11-b2f1-d4e1144a153f req-ee02c613-31c8-4623-a50a-4ce64327b640 service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-unplugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Instance destroyed successfully.
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lazy-loading 'resources' on Instance uuid 70e4833a-d8db-4538-85a5-bce7e252a0c7 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-129612806',display_name='tempest-AttachVolumeTestJSON-server-129612806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-129612806',id=52,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFa+K082cDaGS+5iGbO6kkRhS3qhQHz4cDdWD09MSAACOcPYe3OXkt+FP+3qcw9v0dq52byGzCHa11DT+NryaHf0Xbkh64bJsrXyE3tKnlsoZsb7VqaHR5iLqEfqvdjgIw==',key_name='tempest-keypair-82897199',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:15:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39ae89917b5d41f5bc1216f055dc263d',ramdisk_id='',reservation_id='r-5qbni4ha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-689484882',owner_user_name='tempest-AttachVolumeTestJSON-689484882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c0abdcb59a49a5b5aae8f0ef925f27',uuid=70e4833a-d8db-4538-85a5-bce7e252a0c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converting VIF {"id": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "address": "fa:16:3e:a4:41:a0", "network": {"id": "108b231f-afec-4fe2-9d61-fc9e64391d16", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1067248515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39ae89917b5d41f5bc1216f055dc263d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c9d2d2-58", "ovs_interfaceid": "e4c9d2d2-58dc-4978-b8fe-aeff2f017429", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG os_vif [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4c9d2d2-58, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c755cdb3-c1de-4cf1-bfc4-aac3006b2cd8) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:46 user nova-compute[74839]: INFO os_vif [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:41:a0,bridge_name='br-int',has_traffic_filtering=True,id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429,network=Network(108b231f-afec-4fe2-9d61-fc9e64391d16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c9d2d2-58')
Nov 18 16:18:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Deleting instance files /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7_del
Nov 18 16:18:46 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Deletion of /opt/stack/data/nova/instances/70e4833a-d8db-4538-85a5-bce7e252a0c7_del complete
Nov 18 16:18:46 user nova-compute[74839]: INFO nova.compute.manager [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 18 16:18:46 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:18:46 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:18:47 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Took 0.83 seconds to deallocate network for instance.
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-6611b44d-3e19-400f-9a84-cf00a5381cc7 req-d5ee8376-30a5-4e64-a035-8809f93ac74a service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-deleted-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:18:47 user nova-compute[74839]: INFO nova.compute.manager [req-6611b44d-3e19-400f-9a84-cf00a5381cc7 req-d5ee8376-30a5-4e64-a035-8809f93ac74a service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Neutron deleted interface e4c9d2d2-58dc-4978-b8fe-aeff2f017429; detaching it from the instance and deleting it from the info cache
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.network.neutron [req-6611b44d-3e19-400f-9a84-cf00a5381cc7 req-d5ee8376-30a5-4e64-a035-8809f93ac74a service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.compute.manager [req-6611b44d-3e19-400f-9a84-cf00a5381cc7 req-d5ee8376-30a5-4e64-a035-8809f93ac74a service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Detach interface failed, port_id=e4c9d2d2-58dc-4978-b8fe-aeff2f017429, reason: Instance 70e4833a-d8db-4538-85a5-bce7e252a0c7 could not be found. {{(pid=74839) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:18:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:47 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Deleted allocations for instance 70e4833a-d8db-4538-85a5-bce7e252a0c7
Nov 18 16:18:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-833a1223-367e-462c-9666-90687a78e16a tempest-AttachVolumeTestJSON-689484882 tempest-AttachVolumeTestJSON-689484882-project-member] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:18:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] Acquiring lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:18:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:18:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] Lock "70e4833a-d8db-4538-85a5-bce7e252a0c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:18:48 user nova-compute[74839]: DEBUG nova.compute.manager [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] No waiting events found dispatching network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:18:48 user nova-compute[74839]: WARNING nova.compute.manager [req-8bbc4f57-8404-472c-9fe2-e0072e4ecc6a req-0fe09207-d39d-4610-9bc9-4d3ba4821e4f service nova] [instance: 70e4833a-d8db-4538-85a5-bce7e252a0c7] Received unexpected event network-vif-plugged-e4c9d2d2-58dc-4978-b8fe-aeff2f017429 for instance with vm_state deleted and task_state None.
Nov 18 16:18:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:18:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:19:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:19:12 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:19:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:19:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.180553436279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:19:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:19:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:19:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:19:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:19:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:19:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:20:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:20:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9153MB free_disk=25.17813491821289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:20:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:20:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:37 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:20:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:20:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:53 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:20:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:21:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:21:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:21:15 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.166980743408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:21:15 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:21:18 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:21:22 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:27 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:30 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Starting instance... {{(pid=74839) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74839) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 18 16:21:36 user nova-compute[74839]: INFO nova.compute.claims [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Claim successful on node user
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Start building networks asynchronously for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Allocating IP information in the background. {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 18 16:21:36 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] allocate_for_instance() {{(pid=74839) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 18 16:21:36 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 18 16:21:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Start building block device mappings for instance. {{(pid=74839) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Start spawning the instance on the hypervisor. {{(pid=74839) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Creating instance directory {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 18 16:21:37 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Creating image(s)
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "/opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "/opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "/opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG nova.policy [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d206d3512f14f0bbc8e22b5dc93555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071608865e5445baa57e664d9b67020f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74839) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk 1073741824 {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9,backing_fmt=raw /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk 1073741824" returned: 0 in 0.053s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "c1fdee85614c28dcfbc8200bce9bfd53a824c6d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1fdee85614c28dcfbc8200bce9bfd53a824c6d9 --force-share --output=json" returned: 0 in 0.195s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk. size=1073741824 {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 18 16:21:37 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG nova.virt.disk.api [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Cannot resize image /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk to a smaller size. {{(pid=74839) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Created local disks {{(pid=74839) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Ensure instance console log exists: /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/console.log {{(pid=74839) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:38 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Successfully created port: 3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Successfully updated port: 3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Building network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Instance cache missing network info. {{(pid=74839) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-changed-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.compute.manager [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Refreshing instance network info cache due to event network-changed-3d3485e6-2cb4-4ad2-b598-858851250428. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.neutron [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Instance network_info: |[{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74839) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Refreshing network info cache for port 3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Start _get_guest_xml network_info=[{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'image_id': 'e059a7e6-6151-4faa-8cc1-55745cc1f78a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 18 16:21:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:21:39 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CPU controller missing on host. {{(pid=74839) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.host [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CPU controller found on host. {{(pid=74839) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74839) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-18T15:27:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-18T15:27:56Z,direct_url=<?>,disk_format='qcow2',id=e059a7e6-6151-4faa-8cc1-55745cc1f78a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='5d8f468b6f7b48838b35fbaec10780a4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-18T15:27:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flavor limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Image limits 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flavor pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Image pref 0:0:0 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Got 1 possible topologies {{(pid=74839) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.hardware [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74839) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266166462',display_name='tempest-SnapshotDataIntegrityTests-server-266166462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266166462',id=53,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0tZm1DNs3goq3ZpDJbY9fiC8I3B5hkdQppOwHHAS7HgtTDb5Cjkqk2VMaJSpAftPVBmDUQIVHwXlvKA6pXiaO0NvcS+IF4ykFlXtovfPuEaqGtk01K+PzHl7p7wvPV9A==',key_name='tempest-keypair-1801734807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='071608865e5445baa57e664d9b67020f',ramdisk_id='',reservation_id='r-e8o00w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1021343658',owner_user_name='tempest-SnapshotDataIntegrityTests-1021343658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d206d3512f14f0bbc8e22b5dc93555d',uuid=650efc44-c371-4ad7-939f-8dcaa94564e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74839) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converting VIF {"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.objects.instance [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'pci_devices' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] End _get_guest_xml xml=<domain type="kvm">
Nov 18 16:21:39 user nova-compute[74839]:   <uuid>650efc44-c371-4ad7-939f-8dcaa94564e0</uuid>
Nov 18 16:21:39 user nova-compute[74839]:   <name>instance-00000035</name>
Nov 18 16:21:39 user nova-compute[74839]:   <memory>524288</memory>
Nov 18 16:21:39 user nova-compute[74839]:   <vcpu>1</vcpu>
Nov 18 16:21:39 user nova-compute[74839]:   <metadata>
Nov 18 16:21:39 user nova-compute[74839]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 18 16:21:39 user nova-compute[74839]:       <nova:package version="0.0.0"/>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-266166462</nova:name>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:creationTime>2023-11-18 16:21:39</nova:creationTime>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:flavor name="m1.tiny">
Nov 18 16:21:39 user nova-compute[74839]:         <nova:memory>512</nova:memory>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:disk>1</nova:disk>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:swap>0</nova:swap>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:ephemeral>0</nova:ephemeral>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:vcpus>1</nova:vcpus>
Nov 18 16:21:39 user nova-compute[74839]:       </nova:flavor>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:owner>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:user uuid="1d206d3512f14f0bbc8e22b5dc93555d">tempest-SnapshotDataIntegrityTests-1021343658-project-member</nova:user>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:project uuid="071608865e5445baa57e664d9b67020f">tempest-SnapshotDataIntegrityTests-1021343658</nova:project>
Nov 18 16:21:39 user nova-compute[74839]:       </nova:owner>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:root type="image" uuid="e059a7e6-6151-4faa-8cc1-55745cc1f78a"/>
Nov 18 16:21:39 user nova-compute[74839]:       <nova:ports>
Nov 18 16:21:39 user nova-compute[74839]:         <nova:port uuid="3d3485e6-2cb4-4ad2-b598-858851250428">
Nov 18 16:21:39 user nova-compute[74839]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 18 16:21:39 user nova-compute[74839]:         </nova:port>
Nov 18 16:21:39 user nova-compute[74839]:       </nova:ports>
Nov 18 16:21:39 user nova-compute[74839]:     </nova:instance>
Nov 18 16:21:39 user nova-compute[74839]:   </metadata>
Nov 18 16:21:39 user nova-compute[74839]:   <sysinfo type="smbios">
Nov 18 16:21:39 user nova-compute[74839]:     <system>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="product">OpenStack Nova</entry>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="version">0.0.0</entry>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="serial">650efc44-c371-4ad7-939f-8dcaa94564e0</entry>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="uuid">650efc44-c371-4ad7-939f-8dcaa94564e0</entry>
Nov 18 16:21:39 user nova-compute[74839]:       <entry name="family">Virtual Machine</entry>
Nov 18 16:21:39 user nova-compute[74839]:     </system>
Nov 18 16:21:39 user nova-compute[74839]:   </sysinfo>
Nov 18 16:21:39 user nova-compute[74839]:   <os>
Nov 18 16:21:39 user nova-compute[74839]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 18 16:21:39 user nova-compute[74839]:     <boot dev="hd"/>
Nov 18 16:21:39 user nova-compute[74839]:     <smbios mode="sysinfo"/>
Nov 18 16:21:39 user nova-compute[74839]:   </os>
Nov 18 16:21:39 user nova-compute[74839]:   <features>
Nov 18 16:21:39 user nova-compute[74839]:     <acpi/>
Nov 18 16:21:39 user nova-compute[74839]:     <apic/>
Nov 18 16:21:39 user nova-compute[74839]:     <vmcoreinfo/>
Nov 18 16:21:39 user nova-compute[74839]:   </features>
Nov 18 16:21:39 user nova-compute[74839]:   <clock offset="utc">
Nov 18 16:21:39 user nova-compute[74839]:     <timer name="pit" tickpolicy="delay"/>
Nov 18 16:21:39 user nova-compute[74839]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 18 16:21:39 user nova-compute[74839]:     <timer name="hpet" present="no"/>
Nov 18 16:21:39 user nova-compute[74839]:   </clock>
Nov 18 16:21:39 user nova-compute[74839]:   <cpu mode="custom" match="exact">
Nov 18 16:21:39 user nova-compute[74839]:     <model>Nehalem</model>
Nov 18 16:21:39 user nova-compute[74839]:     <topology sockets="1" cores="1" threads="1"/>
Nov 18 16:21:39 user nova-compute[74839]:   </cpu>
Nov 18 16:21:39 user nova-compute[74839]:   <devices>
Nov 18 16:21:39 user nova-compute[74839]:     <disk type="file" device="disk">
Nov 18 16:21:39 user nova-compute[74839]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 18 16:21:39 user nova-compute[74839]:       <source file="/opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk"/>
Nov 18 16:21:39 user nova-compute[74839]:       <target dev="vda" bus="virtio"/>
Nov 18 16:21:39 user nova-compute[74839]:     </disk>
Nov 18 16:21:39 user nova-compute[74839]:     <interface type="ethernet">
Nov 18 16:21:39 user nova-compute[74839]:       <mac address="fa:16:3e:ea:16:36"/>
Nov 18 16:21:39 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:21:39 user nova-compute[74839]:       <mtu size="1442"/>
Nov 18 16:21:39 user nova-compute[74839]:       <target dev="tap3d3485e6-2c"/>
Nov 18 16:21:39 user nova-compute[74839]:     </interface>
Nov 18 16:21:39 user nova-compute[74839]:     <serial type="pty">
Nov 18 16:21:39 user nova-compute[74839]:       <log file="/opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/console.log" append="off"/>
Nov 18 16:21:39 user nova-compute[74839]:     </serial>
Nov 18 16:21:39 user nova-compute[74839]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 18 16:21:39 user nova-compute[74839]:     <video>
Nov 18 16:21:39 user nova-compute[74839]:       <model type="virtio"/>
Nov 18 16:21:39 user nova-compute[74839]:     </video>
Nov 18 16:21:39 user nova-compute[74839]:     <rng model="virtio">
Nov 18 16:21:39 user nova-compute[74839]:       <backend model="random">/dev/urandom</backend>
Nov 18 16:21:39 user nova-compute[74839]:     </rng>
Nov 18 16:21:39 user nova-compute[74839]:     <controller type="usb" index="0" model="none"/>
Nov 18 16:21:39 user nova-compute[74839]:     <memballoon model="virtio">
Nov 18 16:21:39 user nova-compute[74839]:       <stats period="10"/>
Nov 18 16:21:39 user nova-compute[74839]:     </memballoon>
Nov 18 16:21:39 user nova-compute[74839]:   </devices>
Nov 18 16:21:39 user nova-compute[74839]: </domain>
Nov 18 16:21:39 user nova-compute[74839]:  {{(pid=74839) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266166462',display_name='tempest-SnapshotDataIntegrityTests-server-266166462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266166462',id=53,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0tZm1DNs3goq3ZpDJbY9fiC8I3B5hkdQppOwHHAS7HgtTDb5Cjkqk2VMaJSpAftPVBmDUQIVHwXlvKA6pXiaO0NvcS+IF4ykFlXtovfPuEaqGtk01K+PzHl7p7wvPV9A==',key_name='tempest-keypair-1801734807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='071608865e5445baa57e664d9b67020f',ramdisk_id='',reservation_id='r-e8o00w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1021343658',owner_user_name='tempest-SnapshotDataIntegrityTests-1021343658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-18T16:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d206d3512f14f0bbc8e22b5dc93555d',uuid=650efc44-c371-4ad7-939f-8dcaa94564e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converting VIF {"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG os_vif [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c') {{(pid=74839) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33ed70f4-d0a8-55c3-a0d9-163a29ad5136', '_type': 'linux-noop'}}, row=False) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d3485e6-2c, may_exist=True, interface_attrs={}) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d3485e6-2c, col_values=(('qos', UUID('7d68b046-337f-4553-a5ec-abb23b3af686')),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d3485e6-2c, col_values=(('external_ids', {'iface-id': '3d3485e6-2cb4-4ad2-b598-858851250428', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:16:36', 'vm-uuid': '650efc44-c371-4ad7-939f-8dcaa94564e0'}),), if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:39 user nova-compute[74839]: INFO os_vif [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c')
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:21:39 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No VIF found with MAC fa:16:3e:ea:16:36, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:21:40 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated VIF entry in instance network info cache for port 3d3485e6-2cb4-4ad2-b598-858851250428. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:21:40 user nova-compute[74839]: DEBUG nova.network.neutron [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:21:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-a8989751-adec-4f46-b7ee-40b3318e9296 req-9df834c0-f1d1-47de-be96-37f65cd0c966 service nova] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG nova.compute.manager [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] No waiting events found dispatching network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:21:41 user nova-compute[74839]: WARNING nova.compute.manager [req-fcfea11b-2697-4199-a940-2130ea9545dd req-2ebc54af-8437-4107-8277-89af19e560fa service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received unexpected event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 for instance with vm_state building and task_state spawning.
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:21:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:21:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:21:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:43 user nova-compute[74839]: DEBUG nova.compute.manager [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] No waiting events found dispatching network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:21:43 user nova-compute[74839]: WARNING nova.compute.manager [req-816eda57-97cf-4503-a526-00cddf17c399 req-a4954cd5-2e06-40ee-b452-7bf7a0c8b8bd service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received unexpected event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 for instance with vm_state building and task_state spawning.
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Instance event wait completed in 0 seconds for  {{(pid=74839) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Guest created on hypervisor {{(pid=74839) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 18 16:21:44 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Instance spawned successfully.
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_cdrom_bus of ide {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_disk_bus of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_input_bus of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_pointer_model of None {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_video_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Found default for hw_vif_model of virtio {{(pid=74839) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 18 16:21:44 user nova-compute[74839]: INFO nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 18 16:21:44 user nova-compute[74839]: DEBUG nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Checking state {{(pid=74839) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 18 16:21:44 user nova-compute[74839]: INFO nova.compute.manager [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Took 7.94 seconds to build instance.
Nov 18 16:21:44 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-0436b183-9f4d-44aa-aa04-d242da351a72 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.056s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:21:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:21:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:22:16 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:22:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:22:18 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:22:18 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.124027252197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:22:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:22:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:22:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:22:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:22:40 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:22:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:22:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:13 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:23:13 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:23:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:16 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:17 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:23:17 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:23:17 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8987MB free_disk=25.123493194580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:23:17 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:23:18 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:23:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:23:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:23:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-changed-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:23:27 user nova-compute[74839]: DEBUG nova.compute.manager [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Refreshing instance network info cache due to event network-changed-3d3485e6-2cb4-4ad2-b598-858851250428. {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 18 16:23:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:23:27 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:23:27 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Refreshing network info cache for port 3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 18 16:23:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated VIF entry in instance network info cache for port 3d3485e6-2cb4-4ad2-b598-858851250428. {{(pid=74839) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 18 16:23:28 user nova-compute[74839]: DEBUG nova.network.neutron [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:23:28 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5b1e6c4d-6919-44bf-9bf9-c4d2a94b643e req-5e3d3357-31f9-4fc4-98d2-55fad2f7ae0d service nova] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:23:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:23:30 user nova-compute[74839]: INFO nova.compute.manager [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attaching volume 82c222c5-7edb-4c97-9a32-fbdb318af3e1 to /dev/vdb
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b2c37-bd4a-4a86-9dac-f654f874bae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede533d7-5ca2-4a25-b2d4-244cdc6dd676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06958c8-f925-4dd9-9042-097030339b6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd791e2-f32e-4b28-8902-3eee550a630a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:23:30 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:23:30 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c5e759-a5d9-4d76-97c0-0c41b3a5bde3]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG os_brick.utils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:23:30 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating existing volume attachment record: 78b0b1a3-6153-4ae9-8210-1a630ade50e7 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:23:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stQlyIZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:23:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:23:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:23:35 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee171c-a040-437e-9bd1-85096f045db6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:23:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc937df-b9e7-4d78-a788-ba7f4456494d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1] added
Nov 18 16:23:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b6f04-c9ce-4864-a461-af6abfb82460]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b1cac8-10db-4b5c-b339-9dbde198cd90]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stQlyIZg {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stQlyIZg" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[51037d18-c7f4-40bf-81e3-4d31244b3c0f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'stQlyIZg'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f851d-c0b1-4b50-96a6-f35fe228f974]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b8b4b5-84fb-4a68-b5cb-8b7b7fcc9332]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:23:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:23:35 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:23:35 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:23:35 user nova-compute[74839]: 
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f53028-f9e7-4259-b731-fc559626e873]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260]
Nov 18 16:23:35 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260] successful.
Nov 18 16:23:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb116e-289e-4c0b-b8e7-7eb072585dd0]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f25ea-0dae-43d6-a05a-999727a9fbf7]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)
Nov 18 16:23:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)
Nov 18 16:23:35 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fba181-320a-4bc1-a967-edeb7b2fd40c]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:23:35 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stQlyIZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23064313832343732', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064313832343732', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG nova.objects.instance [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:23:36 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:23:36 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:23:36 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:23:36 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:23:36 user nova-compute[74839]:   <serial>82c222c5-7edb-4c97-9a32-fbdb318af3e1</serial>
Nov 18 16:23:36 user nova-compute[74839]: </disk>
Nov 18 16:23:36 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:23:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:23:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:23:37 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No VIF found with MAC fa:16:3e:ea:16:36, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:23:37 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-8c89ace1-bc85-43a9-a198-711d9ab73405 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.030s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:23:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:23:48 user nova-compute[74839]: INFO nova.compute.manager [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Detaching volume 82c222c5-7edb-4c97-9a32-fbdb318af3e1
Nov 18 16:23:48 user nova-compute[74839]: INFO nova.virt.block_device [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attempting to driver detach volume 82c222c5-7edb-4c97-9a32-fbdb318af3e1 from mountpoint /dev/vdb
Nov 18 16:23:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Attempting to detach device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:23:48 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:23:48 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:23:48 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:23:48 user nova-compute[74839]:   <serial>82c222c5-7edb-4c97-9a32-fbdb318af3e1</serial>
Nov 18 16:23:48 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:23:48 user nova-compute[74839]: </disk>
Nov 18 16:23:48 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:23:48 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config.
Nov 18 16:23:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:23:48 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:23:48 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:23:48 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:23:48 user nova-compute[74839]:   <serial>82c222c5-7edb-4c97-9a32-fbdb318af3e1</serial>
Nov 18 16:23:48 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:23:48 user nova-compute[74839]: </disk>
Nov 18 16:23:48 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:23:48 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:23:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:23:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:08 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 is timed out.
Nov 18 16:24:08 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config.
Nov 18 16:24:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stQlyIZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:24:08 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe025de-c2e4-473b-b419-b59e26aa7076]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:24:08 user nova-compute[74839]: No targets found.
Nov 18 16:24:08 user nova-compute[74839]: iSNS:
Nov 18 16:24:08 user nova-compute[74839]: No targets found.
Nov 18 16:24:08 user nova-compute[74839]: STATIC:
Nov 18 16:24:08 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1
Nov 18 16:24:08 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:24:08 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:24:08 user nova-compute[74839]: FIRMWARE:
Nov 18 16:24:08 user nova-compute[74839]: No targets found.
Nov 18 16:24:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:24:08 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:24:08 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5c714-e56f-426f-a4d0-146f727a2cc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[457cecd5-bdb6-4522-ac20-fdd99dfd81b8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)
Nov 18 16:24:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 (non-flash)
Nov 18 16:24:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd45c52b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44c00d2-196c-4b48-9de6-ab8d86447739]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b4ef8-f432-4489-bc94-0243661d5498]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[898ee001-c9ea-42c0-a08a-7dc8d0570435]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3134eacb-d89b-4aba-b31f-3f432eff7379]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9689f86-84b6-430a-b468-f2e033b0f19a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29f456-2ace-4985-94ac-cb1eb6157dea]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260]
Nov 18 16:24:08 user nova-compute[74839]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1, portal: 172.16.0.220,3260] successful.
Nov 18 16:24:08 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82c222c5-7edb-4c97-9a32-fbdb318af3e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc77361-d495-42b1-bba2-ef4040611eaf]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== disconnect_volume: return (278ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:24:08 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:24:09 user nova-compute[74839]: DEBUG nova.objects.instance [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:24:09 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-c8987ec1-cbb5-40b1-9d7f-c5602215b215 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.590s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:24:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:24:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:24:18 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:19 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:24:19 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.122234344482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:24:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:24:20 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:24:20 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:24:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:24 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:24:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:24:40 user nova-compute[74839]: INFO nova.compute.manager [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attaching volume a0845101-4e04-4fc5-92fe-3c9d3683a630 to /dev/vdb
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.utils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[098c69ea-9355-4168-b8b3-aed963651650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8e99a-8012-4cd1-9b73-ab6864835b26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e444d-d4ab-4988-81fc-3d8b1e893345]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[02054d62-c5f9-4710-ac53-236766839b30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:24:40 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:24:40 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af72d0-fb2c-4011-b8a0-7f382840ec9e]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG os_brick.utils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:24:40 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating existing volume attachment record: 2079094f-8e49-49b9-9e86-98bc17508768 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:24:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:24:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpqhFayK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:24:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:24:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:24:45 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c7d9f5-7581-4eb3-89a2-fe5dae54bcd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:24:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6404ab2-fe1b-4c04-a2ac-19ab2674818c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630] added
Nov 18 16:24:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4f740-488c-49cb-bb2b-c07e327b521a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[50693b38-b3fc-42b4-97ae-77f818a708e6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpqhFayK {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpqhFayK" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a093fa93-4c20-4bff-aefd-9ec174315b8f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpqhFayK'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b51621-e1eb-442b-a75d-02434ad8f3d6]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b22a84-518f-4cc5-a082-65fc89d14593]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:24:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:24:45 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:24:45 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:24:45 user nova-compute[74839]: 
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbe768-ca33-43ac-915e-ffb2e17efbbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260]
Nov 18 16:24:45 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260] successful.
Nov 18 16:24:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc76505-f978-4512-a64b-2bbd105fdabd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd53708-72fe-4f2c-8ed9-8f8b3ceb5cf5]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)
Nov 18 16:24:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)
Nov 18 16:24:45 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ec800-d987-4a9d-9128-4b271f311024]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:24:45 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpqhFayK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23835383232313766', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835383232313766', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:24:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:24:46 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:24:46 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:24:46 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:24:46 user nova-compute[74839]:   <serial>a0845101-4e04-4fc5-92fe-3c9d3683a630</serial>
Nov 18 16:24:46 user nova-compute[74839]: </disk>
Nov 18 16:24:46 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:24:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:24:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:24:47 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No VIF found with MAC fa:16:3e:ea:16:36, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:24:47 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f450b09f-f9b3-49dc-b03e-0c375ac8ca59 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.097s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:24:49 user nova-compute[74839]: INFO nova.compute.manager [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Detaching volume a0845101-4e04-4fc5-92fe-3c9d3683a630
Nov 18 16:24:49 user nova-compute[74839]: INFO nova.virt.block_device [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attempting to driver detach volume a0845101-4e04-4fc5-92fe-3c9d3683a630 from mountpoint /dev/vdb
Nov 18 16:24:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Attempting to detach device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:24:49 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:24:49 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:24:49 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:24:49 user nova-compute[74839]:   <serial>a0845101-4e04-4fc5-92fe-3c9d3683a630</serial>
Nov 18 16:24:49 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:24:49 user nova-compute[74839]: </disk>
Nov 18 16:24:49 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:24:49 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config.
Nov 18 16:24:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:24:49 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:24:49 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:24:49 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:24:49 user nova-compute[74839]:   <serial>a0845101-4e04-4fc5-92fe-3c9d3683a630</serial>
Nov 18 16:24:49 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:24:49 user nova-compute[74839]: </disk>
Nov 18 16:24:49 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:24:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:24:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:24:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:09 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 is timed out.
Nov 18 16:25:09 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config.
Nov 18 16:25:09 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpqhFayK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:25:09 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b31d4-4016-48ae-a99b-5c85c9825a6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:25:09 user nova-compute[74839]: No targets found.
Nov 18 16:25:09 user nova-compute[74839]: iSNS:
Nov 18 16:25:09 user nova-compute[74839]: No targets found.
Nov 18 16:25:09 user nova-compute[74839]: STATIC:
Nov 18 16:25:09 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630
Nov 18 16:25:09 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:25:09 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:25:09 user nova-compute[74839]: FIRMWARE:
Nov 18 16:25:09 user nova-compute[74839]: No targets found.
Nov 18 16:25:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:25:09 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:25:09 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[6530749f-4285-449c-8f2b-af5a50cccd63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba67e65-aacf-4b12-804d-893db7b35783]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)
Nov 18 16:25:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 (non-flash)
Nov 18 16:25:09 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4a11e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1c29d-9146-4d6c-bcdb-1a01b565bb73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2042d01-362f-416f-91b9-9d6aa624f1bd]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa7c3d-55cc-46e8-8f7f-83e563aec17d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:25:09 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e9fba-6306-4a6d-9016-640af42d30d7]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b835c-bc4b-4c6e-a02d-a70a123de3ed]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d717c71-8602-4db5-8a0c-019659a9c7db]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260]
Nov 18 16:25:10 user nova-compute[74839]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630, portal: 172.16.0.220,3260] successful.
Nov 18 16:25:10 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0845101-4e04-4fc5-92fe-3c9d3683a630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c8dd6-0051-426a-a994-08b24391bc42]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== disconnect_volume: return (288ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG nova.objects.instance [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:25:10 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-742ea6de-ef12-4e12-aa98-f259244d5d01 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:25:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:25:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:25:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=25.121265411376953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:25:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:25:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:25:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:24 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:25:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:25:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG nova.objects.instance [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:25:41 user nova-compute[74839]: INFO nova.compute.manager [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attaching volume 3d5ba5da-78d5-42cb-b695-fe22e274a1b1 to /dev/vdb
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37e78d9-9311-45de-9674-f09d0089f4af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a65e15e-05f2-4d50-9a95-e5e933b22a9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[40355dbf-ac98-4d62-b1ee-ec9cb6a447a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36c225-ce48-4e80-bafa-5f39fc933346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:25:41 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:25:41 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5d790-b310-4f26-bd13-a0f663899d38]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG os_brick.utils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:25:41 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating existing volume attachment record: d4458f12-d026-4b0b-a3a8-54e3855c1b0e {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:25:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyBNobSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:25:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:25:46 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:25:46 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[83327128-299f-4db8-a6dd-9f644f8197f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:25:46 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3f509-b253-4929-8948-96ca2008c752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1] added
Nov 18 16:25:46 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b611b5-ed9f-49a0-b91f-efa07a563649]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc40fe7-a52b-40aa-803d-339bc7613f8f]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyBNobSv {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyBNobSv" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c005b5e-8179-4171-9d4d-d2d2e55f6d80]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AyBNobSv'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:46 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c744df4-7c10-4f95-b122-69aff7348c05]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db82ff5-ad6e-4d46-a366-5ce173a4abaf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:25:47 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:25:47 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:25:47 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:25:47 user nova-compute[74839]: 
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495fab5-9310-4f06-8977-dc96a1c9105e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260]
Nov 18 16:25:47 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260] successful.
Nov 18 16:25:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9552e226-69cf-4904-8d9b-7726219af2dd]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff953e34-12aa-4009-a5fb-167fc68ed9de]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)
Nov 18 16:25:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)
Nov 18 16:25:47 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d9641-d231-430c-9245-c5352ac4dd81]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:25:47 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyBNobSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23035666537646662', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035666537646662', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.objects.instance [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:25:48 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:25:48 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:25:48 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:25:48 user nova-compute[74839]:   <serial>3d5ba5da-78d5-42cb-b695-fe22e274a1b1</serial>
Nov 18 16:25:48 user nova-compute[74839]: </disk>
Nov 18 16:25:48 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No VIF found with MAC fa:16:3e:ea:16:36, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:25:48 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-950b7a97-9095-4bf0-a802-b20a826b8027 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.201s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:25:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:25:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:25:50 user nova-compute[74839]: INFO nova.compute.manager [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Detaching volume 3d5ba5da-78d5-42cb-b695-fe22e274a1b1
Nov 18 16:25:50 user nova-compute[74839]: INFO nova.virt.block_device [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attempting to driver detach volume 3d5ba5da-78d5-42cb-b695-fe22e274a1b1 from mountpoint /dev/vdb
Nov 18 16:25:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Attempting to detach device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:25:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:25:50 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:25:50 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:25:50 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:25:50 user nova-compute[74839]:   <serial>3d5ba5da-78d5-42cb-b695-fe22e274a1b1</serial>
Nov 18 16:25:50 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:25:50 user nova-compute[74839]: </disk>
Nov 18 16:25:50 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:25:50 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config.
Nov 18 16:25:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:25:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:25:50 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:25:50 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:25:50 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:25:50 user nova-compute[74839]:   <serial>3d5ba5da-78d5-42cb-b695-fe22e274a1b1</serial>
Nov 18 16:25:50 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:25:50 user nova-compute[74839]: </disk>
Nov 18 16:25:50 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:25:51 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:25:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:25:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:26:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:11 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 is timed out.
Nov 18 16:26:11 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config.
Nov 18 16:26:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyBNobSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:26:11 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[13006392-0c40-43d1-b77e-42920934571a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:26:11 user nova-compute[74839]: No targets found.
Nov 18 16:26:11 user nova-compute[74839]: iSNS:
Nov 18 16:26:11 user nova-compute[74839]: No targets found.
Nov 18 16:26:11 user nova-compute[74839]: STATIC:
Nov 18 16:26:11 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1
Nov 18 16:26:11 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:26:11 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:26:11 user nova-compute[74839]: FIRMWARE:
Nov 18 16:26:11 user nova-compute[74839]: No targets found.
Nov 18 16:26:11 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:26:11 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:26:11 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf187f62-0192-4932-9d6d-15c75cb0e968]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafee1a6-0f26-4c27-9fcc-4d7e7e97fd6d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)
Nov 18 16:26:11 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 (non-flash)
Nov 18 16:26:11 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd48023d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a4cd68-319f-4c2a-9010-0070f0701381]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a590ffc8-2a36-49b9-8e07-330c80e3eb8c]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[44239517-d681-4355-b12e-ae2079fa1674]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c800d6-4f53-4520-86c0-ebde8a278f9e]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63be197-c685-4ec0-adf8-722b8703473a]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e955863-7fea-4bc4-beba-d6b30fc653b6]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260]
Nov 18 16:26:11 user nova-compute[74839]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1, portal: 172.16.0.220,3260] successful.
Nov 18 16:26:11 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d5ba5da-78d5-42cb-b695-fe22e274a1b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4afa2-2b11-4b4d-9136-18274c7987e8]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== disconnect_volume: return (298ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:26:11 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:26:12 user nova-compute[74839]: DEBUG nova.objects.instance [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:26:12 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-f88f65db-5696-4bc3-84d9-0f37c3a2d8f9 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:26:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:26:19 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:26:20 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:26:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.120262145996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:26:20 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:26:21 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:26:21 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:26:21 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:26:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:26:24 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:41 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:26:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:26:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:26:42 user nova-compute[74839]: DEBUG nova.objects.instance [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:26:42 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:26:43 user nova-compute[74839]: INFO nova.compute.manager [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attaching volume acf5ad5c-b078-4d8d-b6ce-4dd971276ecd to /dev/vdb
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.utils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d8af83-8c0c-4cd7-9446-6728f2b6b0e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d36a341eb5d\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[186faa3e-5703-458e-8f02-d0c816fb4895]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe7c27-0ca4-4438-ac3c-ffe56309acbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[78112771-dc8c-4516-9fff-5231b7ce2351]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Running cmd (subprocess): nvme version {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] 'nvme version' failed. Not Retrying. {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] nvme not present on system {{(pid=74839) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 18 16:26:43 user nova-compute[74839]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 18 16:26:43 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8856c-b4c7-41c5-a3c7-5fbc8a44446b]: (4, '') {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74839) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.lightos [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] LIGHTOS: no hostnqn found. {{(pid=74839) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG os_brick.utils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d36a341eb5d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:26:43 user nova-compute[74839]: DEBUG nova.virt.block_device [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating existing volume attachment record: 337122cd-ecf4-497c-afb0-bf9cc3b95310 {{(pid=74839) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 18 16:26:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Calling os-brick to attach iSCSI Volume {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlCpZib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:26:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:26:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:26:48 user nova-compute[74839]: INFO os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8dac72-0908-4be6-8eda-0137390b1e08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 18 16:26:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --interface default --op new {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1947a-38f4-447b-b5e9-8dc317321699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd] added\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd] added
Nov 18 16:26:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101c582-f682-49a7-b06d-41da43cd2d4e]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4935200-e863-44b8-a7d2-bdb19100076d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnlCpZib {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnlCpZib" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c843a18-0437-4948-9354-3f3b8b5505a9]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnlCpZib'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc64a33e-8fc1-4bf9-8b38-18b6ac599324]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c58b0-d284-47d0-8079-0bba598186c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:26:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 18 16:26:48 user nova-compute[74839]:  {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:26:48 user nova-compute[74839]: WARNING os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 18 16:26:48 user nova-compute[74839]: 
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --login {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ee8a3b-93fb-41a6-86e5-eb903ffbafb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260]
Nov 18 16:26:48 user nova-compute[74839]: Login to [iface: default, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260] successful.
Nov 18 16:26:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[54362cde-3e67-45a5-a350-0795b7e9a51d]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[709994fb-b7f6-4792-b178-b085c71bc823]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)
Nov 18 16:26:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)
Nov 18 16:26:48 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to 172.16.0.220:3260 {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74839) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74839) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fbb323-6569-4f66-a07b-2db7b061f935]: (4, ('- - 0', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74839) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 18 16:26:48 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlCpZib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74839) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 18 16:26:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:26:49 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23261643564643033', 'path': '/dev/sdb'} {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:26:49 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261643564643033', 'path': '/dev/sdb'} {{(pid=74839) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 18 16:26:49 user nova-compute[74839]: DEBUG nova.objects.instance [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:26:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] attach device xml: <disk type="block" device="disk">
Nov 18 16:26:50 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:26:50 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:26:50 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:26:50 user nova-compute[74839]:   <serial>acf5ad5c-b078-4d8d-b6ce-4dd971276ecd</serial>
Nov 18 16:26:50 user nova-compute[74839]: </disk>
Nov 18 16:26:50 user nova-compute[74839]:  {{(pid=74839) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 18 16:26:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vda, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:26:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74839) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 18 16:26:50 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] No VIF found with MAC fa:16:3e:ea:16:36, not building metadata {{(pid=74839) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 18 16:26:50 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-dbaceb7c-89cd-44e1-96d8-912ff9a6d86d tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.405s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:26:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:26:52 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:26:52 user nova-compute[74839]: INFO nova.compute.manager [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Detaching volume acf5ad5c-b078-4d8d-b6ce-4dd971276ecd
Nov 18 16:26:52 user nova-compute[74839]: INFO nova.virt.block_device [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Attempting to driver detach volume acf5ad5c-b078-4d8d-b6ce-4dd971276ecd from mountpoint /dev/vdb
Nov 18 16:26:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Attempting to detach device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config. {{(pid=74839) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 18 16:26:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:26:52 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:26:52 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:26:52 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:26:52 user nova-compute[74839]:   <serial>acf5ad5c-b078-4d8d-b6ce-4dd971276ecd</serial>
Nov 18 16:26:52 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:26:52 user nova-compute[74839]: </disk>
Nov 18 16:26:52 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:26:52 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the persistent domain config.
Nov 18 16:26:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config. {{(pid=74839) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 18 16:26:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.guest [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] detach device xml: <disk type="block" device="disk">
Nov 18 16:26:52 user nova-compute[74839]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 18 16:26:52 user nova-compute[74839]:   <source dev="/dev/sdb"/>
Nov 18 16:26:52 user nova-compute[74839]:   <target dev="vdb" bus="virtio"/>
Nov 18 16:26:52 user nova-compute[74839]:   <serial>acf5ad5c-b078-4d8d-b6ce-4dd971276ecd</serial>
Nov 18 16:26:52 user nova-compute[74839]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 18 16:26:52 user nova-compute[74839]: </disk>
Nov 18 16:26:52 user nova-compute[74839]:  {{(pid=74839) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 18 16:26:52 user nova-compute[74839]: DEBUG nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 18 16:26:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:26:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:04 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:09 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:12 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 is timed out.
Nov 18 16:27:12 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully detached device vdb from instance 650efc44-c371-4ad7-939f-8dcaa94564e0 from the live domain config.
Nov 18 16:27:12 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] calling os-brick to detach iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd48053be80>, {'target_iqn': 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnlCpZib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 18 16:27:12 user nova-compute[74839]: WARNING os_brick.initiator.connectors.base [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cbeb2-384d-466b-9f02-b5e5d6ea044b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 18 16:27:12 user nova-compute[74839]: No targets found.
Nov 18 16:27:12 user nova-compute[74839]: iSNS:
Nov 18 16:27:12 user nova-compute[74839]: No targets found.
Nov 18 16:27:12 user nova-compute[74839]: STATIC:
Nov 18 16:27:12 user nova-compute[74839]: Target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd
Nov 18 16:27:12 user nova-compute[74839]:         Portal: 172.16.0.220:3260,-1
Nov 18 16:27:12 user nova-compute[74839]:                 Iface Name: default
Nov 18 16:27:12 user nova-compute[74839]: FIRMWARE:
Nov 18 16:27:12 user nova-compute[74839]: No targets found.
Nov 18 16:27:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 18 16:27:12 user nova-compute[74839]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 18 16:27:12 user nova-compute[74839]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74839) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd', 0)] {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f63ea1-2281-4e31-8409-6582e7007f7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faf6eb1-7ec1-4b8c-85e4-a2d6ea6524e3]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)
Nov 18 16:27:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd (non-flash)
Nov 18 16:27:12 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4801d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd'): ({'sdb'}, set())}) {{(pid=74839) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Removing single pathed devices sdb {{(pid=74839) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a057f52-c8b7-425b-8910-28ccc5976e3d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ea247-87c0-4f5d-9b84-de8f306d9f1f]: (4, ('ok\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Flushing IO for device /dev/sdb {{(pid=74839) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c95557-cb8d-40f1-ae32-508d99180920]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74839) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 18 16:27:12 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[300a1aaa-6116-420d-8242-7b84f5b406f1]: (4, ('1', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] SCSI volumes sdb have been removed. {{(pid=74839) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd')] {{(pid=74839) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6347cff-32e1-4116-83b9-19e2d25943e4]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --logout {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d912d-25d0-4c70-a48c-3fd356e39b56]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260]
Nov 18 16:27:13 user nova-compute[74839]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd, portal: 172.16.0.220,3260] successful.
Nov 18 16:27:13 user nova-compute[74839]:  stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op delete {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acf5ad5c-b078-4d8d-b6ce-4dd971276ecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e805b3a-802f-4f9b-8521-d0c8507598ed]: (4, ('', '')) {{(pid=85739) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74839) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.base [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] <== disconnect_volume: return (300ms) None {{(pid=74839) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Disconnected iSCSI Volume {{(pid=74839) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG nova.objects.instance [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'flavor' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:27:13 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-fd8a58a9-608e-4744-9d78-32e0800d8581 tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:27:14 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:19 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:27:21 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.processutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74839) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 18 16:27:22 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:27:22 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.119300842285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Instance 650efc44-c371-4ad7-939f-8dcaa94564e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74839) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:27:22 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:27:24 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:24 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:27:24 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquired lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Forcefully refreshing network info cache for instance {{(pid=74839) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG nova.objects.instance [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lazy-loading 'info_cache' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG nova.network.neutron [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [{"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Releasing lock "refresh_cache-650efc44-c371-4ad7-939f-8dcaa94564e0" {{(pid=74839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updated the network info_cache for instance {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:27 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:27:29 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:27:34 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:39 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:44 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:49 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:54 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:27:59 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:00 user nova-compute[74839]: INFO nova.compute.manager [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Terminating instance
Nov 18 16:28:00 user nova-compute[74839]: DEBUG nova.compute.manager [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Start destroying the instance on the hypervisor. {{(pid=74839) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:00 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-unplugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] No waiting events found dispatching network-vif-unplugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.compute.manager [req-5285843f-cf23-4901-a3e8-1a364c54ac03 req-f9a983f9-5d61-46c3-a542-82c8f6151fae service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-unplugged-3d3485e6-2cb4-4ad2-b598-858851250428 for instance with task_state deleting. {{(pid=74839) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Instance destroyed successfully.
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.objects.instance [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lazy-loading 'resources' on Instance uuid 650efc44-c371-4ad7-939f-8dcaa94564e0 {{(pid=74839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.virt.libvirt.vif [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-18T16:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-266166462',display_name='tempest-SnapshotDataIntegrityTests-server-266166462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-266166462',id=53,image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0tZm1DNs3goq3ZpDJbY9fiC8I3B5hkdQppOwHHAS7HgtTDb5Cjkqk2VMaJSpAftPVBmDUQIVHwXlvKA6pXiaO0NvcS+IF4ykFlXtovfPuEaqGtk01K+PzHl7p7wvPV9A==',key_name='tempest-keypair-1801734807',keypairs=<?>,launch_index=0,launched_at=2023-11-18T16:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='071608865e5445baa57e664d9b67020f',ramdisk_id='',reservation_id='r-e8o00w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e059a7e6-6151-4faa-8cc1-55745cc1f78a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1021343658',owner_user_name='tempest-SnapshotDataIntegrityTests-1021343658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-18T16:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d206d3512f14f0bbc8e22b5dc93555d',uuid=650efc44-c371-4ad7-939f-8dcaa94564e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converting VIF {"id": "3d3485e6-2cb4-4ad2-b598-858851250428", "address": "fa:16:3e:ea:16:36", "network": {"id": "c70e64d0-e37f-4f70-b824-fc31632ba3ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-683746822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "071608865e5445baa57e664d9b67020f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d3485e6-2c", "ovs_interfaceid": "3d3485e6-2cb4-4ad2-b598-858851250428", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.network.os_vif_util [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c') {{(pid=74839) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG os_vif [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c') {{(pid=74839) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d3485e6-2c, bridge=br-int, if_exists=True) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d68b046-337f-4553-a5ec-abb23b3af686) {{(pid=74839) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:01 user nova-compute[74839]: INFO os_vif [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:16:36,bridge_name='br-int',has_traffic_filtering=True,id=3d3485e6-2cb4-4ad2-b598-858851250428,network=Network(c70e64d0-e37f-4f70-b824-fc31632ba3ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d3485e6-2c')
Nov 18 16:28:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Deleting instance files /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0_del
Nov 18 16:28:01 user nova-compute[74839]: INFO nova.virt.libvirt.driver [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Deletion of /opt/stack/data/nova/instances/650efc44-c371-4ad7-939f-8dcaa94564e0_del complete
Nov 18 16:28:01 user nova-compute[74839]: INFO nova.compute.manager [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 18 16:28:01 user nova-compute[74839]: DEBUG oslo.service.loopingcall [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74839) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.compute.manager [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Deallocating network for instance {{(pid=74839) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 18 16:28:01 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] deallocate_for_instance() {{(pid=74839) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 18 16:28:02 user nova-compute[74839]: DEBUG nova.network.neutron [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Updating instance_info_cache with network_info: [] {{(pid=74839) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 18 16:28:02 user nova-compute[74839]: INFO nova.compute.manager [-] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Took 0.76 seconds to deallocate network for instance.
Nov 18 16:28:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:02 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:28:02 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:28:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:02 user nova-compute[74839]: INFO nova.scheduler.client.report [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Deleted allocations for instance 650efc44-c371-4ad7-939f-8dcaa94564e0
Nov 18 16:28:02 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-23f05afa-2a17-4bbc-8484-7a33da8352dc tempest-SnapshotDataIntegrityTests-1021343658 tempest-SnapshotDataIntegrityTests-1021343658-project-member] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:28:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] Acquiring lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:03 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] Lock "650efc44-c371-4ad7-939f-8dcaa94564e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] No waiting events found dispatching network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 18 16:28:03 user nova-compute[74839]: WARNING nova.compute.manager [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received unexpected event network-vif-plugged-3d3485e6-2cb4-4ad2-b598-858851250428 for instance with vm_state deleted and task_state None.
Nov 18 16:28:03 user nova-compute[74839]: DEBUG nova.compute.manager [req-06f37406-8c7c-49f7-8865-1053d25055e7 req-1cfe6295-4cd0-4a11-9ff7-83cbab8502f6 service nova] [instance: 650efc44-c371-4ad7-939f-8dcaa94564e0] Received event network-vif-deleted-3d3485e6-2cb4-4ad2-b598-858851250428 {{(pid=74839) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 18 16:28:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:28:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:21 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:22 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 18 16:28:22 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] There are 0 instances to clean {{(pid=74839) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 18 16:28:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:23 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74839) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 18 16:28:23 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Auditing locally available compute resources for user (node: user) {{(pid=74839) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 18 16:28:24 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:28:24 user nova-compute[74839]: WARNING nova.virt.libvirt.driver [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Hypervisor/Node resource view: name=user free_ram=9112MB free_disk=25.146419525146484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74839) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74839) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing inventories for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating ProviderTree inventory for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Updating inventory in ProviderTree for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing aggregate associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, aggregates: None {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Refreshing trait associations for resource provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=74839) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.provider_tree [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed in ProviderTree for provider: 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 {{(pid=74839) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.scheduler.client.report [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Inventory has not changed for provider 1b2bc3b9-1976-45c0-acc1-6705a8c2df60 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74839) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG nova.compute.resource_tracker [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Compute_service record updated for user:user {{(pid=74839) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 18 16:28:24 user nova-compute[74839]: DEBUG oslo_concurrency.lockutils [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74839) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Starting heal instance info cache {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Rebuilding the list of instances to heal {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Didn't find any instances for network info cache update. {{(pid=74839) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:25 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:26 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:26 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:29 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:28:31 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:36 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:36 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:36 user nova-compute[74839]: DEBUG nova.compute.manager [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74839) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 18 16:28:41 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:28:43 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:46 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:51 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:54 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:28:55 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:56 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:28:57 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:29:01 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:29:02 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:29:06 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74839) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74839) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 18 16:29:11 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 18 16:29:14 user nova-compute[74839]: DEBUG oslo_service.periodic_task [None req-87dc0c34-a982-4629-bfb6-6a2d2040f702 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74839) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 18 16:29:16 user nova-compute[74839]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74839) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}